00000001:02000400:3.0F:1788568454.814532:0:2963:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg604-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1788568471.108386:0:3184:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg604-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1788568472.658396:0:3244:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 659 MB/s 00000001:01000000:3.0:1788568472.908220:0:3244:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 807 MB/s 00000001:01000000:3.0:1788568473.158133:0:3244:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 6155 MB/s 00000020:02000000:2.0:1788568473.758504:0:3275:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_2_gfa0a981 00000400:02000000:0.0F:1788568474.725235:0:3290:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.206.104@tcp [8/256/0/180] 00008000:02000000:3.0:1788568478.352254:0:3440:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0F:1788568525.420570:0:5248:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg604-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788568536.048207:0:5824:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788568536.048223:0:5824:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788568536.048356:0:5824:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000008f80f82c 00000080:02000400:3.0:1788568536.048364:0:5824:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1788568536.053577:0:5824:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1788568536.053590:0:5824:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788568536.053627:0:5824:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000060898eeb) 00000020:00000080:3.0:1788568536.053645:0:5824:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788568536.072638:0:5824:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1788568536.073378:0:5824:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788568536.133559:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788568536.134092:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788568536.134119:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788568536.134170:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788568536.134225:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788568536.134564:0:5824:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788568536.136143:0:5824:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788568536.136162:0:5824:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x41e82f464b6a0a0d 00000020:01000004:3.0:1788568536.136172:0:5824:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788568536.136177:0:5824:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788568536.136182:0:5824:0:(tgt_mount.c:101:server_register_mount()) register mount 000000008f80f82c from MGS 00000020:01000004:3.0:1788568536.136186:0:5824:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788568536.136197:0:5824:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000041569566) 00000020:00000080:3.0:1788568536.136208:0:5824:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788568536.136276:0:5824:0:(tgt_mount.c:153:server_get_mount()) get mount 000000008f80f82c from MGS, refs=2 00080000:01000000:3.0:1788568536.136281:0:5824:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788568536.136287:0:5824:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x41e82f464b6a0a1b 00000100:00100000:3.0:1788568536.136404:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788568536.138163:0:5824:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788568536.138186:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788568536.139303:0:5824:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788568536.139311:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788568536.141234:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788568536.141398:0:5824:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788568536.141403:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788568536.145577:0:5824:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788568536.145589:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788568536.146526:0:5824:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788568536.146534:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788568536.147451:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568536.147455:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568536.147457:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568536.148180:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568536.148183:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568536.148185:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568536.148675:0:5824:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788568536.155406:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788568536.402049:0:5824:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2216 MB/s 00000001:01000000:3.0:1788568536.652047:0:5824:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 1979 MB/s 00000001:01000000:3.0:1788568536.903957:0:5824:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 442 MB/s 00000001:01000000:3.0:1788568537.154385:0:5824:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 363 MB/s 00080000:10000000:0.0:1788568537.171107:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:0.0:1788568537.190253:0:5824:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788568537.190270:0:5824:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788568537.190272:0:5824:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1788568537.191397:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788568537.191465:0:5824:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788568537.191508:0:5824:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1788568537.191693:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788568537.191742:0:5824:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788568537.192272:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788568537.192422:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788568537.192428:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788568537.200460:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788568537.200506:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788568537.201850:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788568537.201858:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788568537.202187:0:5824:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788568537.202221:0:5824:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.104@tcp' 00000020:01000004:3.0:1788568537.202223:0:5824:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788568537.202271:0:5824:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.104@tcp (typ=mgc) 00000020:00000080:3.0:1788568537.202281:0:5824:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.104@tcp (00000000ba6ed15e) 00000020:00000080:3.0:1788568537.202296:0:5824:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788568537.202394:0:5824:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ee3b8f53@MGC192.168.206.104@tcp: add connection 192.168.206.104@tcp at head 00010000:00010000:3.0:1788568537.202545:0:5824:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.104@tcp-0 is initialized 00000040:01000000:3.0:1788568537.202551:0:5824:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.104@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788568537.203235:0:5837:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1788568537.203484:0:5838:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788568537.203517:0:5824:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.104@tcp (uuid 925db6b8-84bc-418c-b37a-40345c1020be) 00000020:00000080:1.0:1788568537.203535:0:5824:0:(genops.c:1385:class_connect()) connect: client 925db6b8-84bc-418c-b37a-40345c1020be, cookie 0x41e82f464b6a0a29 00000100:00080000:1.0:1788568537.203545:0:5824:0:(import.c:545:import_select_connection()) MGC192.168.206.104@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788568537.203551:0:5824:0:(import.c:665:import_select_connection()) MGC192.168.206.104@tcp: import 00000000ee3b8f53 using connection 192.168.206.104@tcp/0@lo 00000100:00100000:1.0:1788568537.203585:0:5824:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000cda3ff32 x1875449976193152/t0(0) o250->MGC192.168.206.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788568537.204377:0:5824:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 925db6b8-84bc-418c-b37a-40345c1020be->MGS 00000020:01000004:1.0:1788568537.204395:0:5824:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788568537.204400:0:5824:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788568537.204420:0:5824:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000006a9ad73) 00000020:00000080:1.0:1788568537.204432:0:5824:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788568537.204573:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cda3ff32 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:925db6b8-84bc-418c-b37a-40345c1020be:3305:1875449976193152:0@lo:250: 00000100:00100000:1.0:1788568537.204687:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568537.204754:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976193152 00000100:00100000:1.0:1788568537.204761:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976193152 00000100:00100000:1.0:1788568537.204787:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788568537.204793:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009b454df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3305:x1875449976193152:12345-0@lo:250: 00010000:00080000:1.0:1788568537.204810:0:5834:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 925db6b8-84bc-418c-b37a-40345c1020be@0@lo t0 exp 0000000000000000 cur 171 last 0 00000020:00000080:1.0:1788568537.204829:0:5834:0:(genops.c:1385:class_connect()) connect: client 925db6b8-84bc-418c-b37a-40345c1020be, cookie 0x41e82f464b6a0a37 00000100:00080000:1.0:1788568537.205171:0:5834:0:(import.c:65:import_set_state_nolock()) 00000000d456a353 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788568537.205231:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009b454df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+5:3305:x1875449976193152:12345-0@lo:250: Request processed in 437us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568537.205238:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788568537.205284:0:3305:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.104@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788568537.205292:0:3305:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.206.104@tcp: connect to target with instance 0 00000100:00080000:1.0:1788568537.205298:0:3305:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.206.104@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788568537.205302:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788568537.205305:0:3305:0:(import.c:65:import_set_state_nolock()) 00000000ee3b8f53 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788568537.205308:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788568537.205315:0:3305:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788568537.205319:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cda3ff32 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:925db6b8-84bc-418c-b37a-40345c1020be:3305:1875449976193152:0@lo:250: 00010000:00010000:2.0:1788568537.216951:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568537.251792:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788568537.252088:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788568537.252094:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788568537.257052:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788568537.257065:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788568537.264850:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788568537.264864:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788568537.265669:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788568537.265843:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788568537.265848:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788568537.267425:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788568537.267441:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788568537.395612:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788568537.398376:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788568537.398384:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788568537.402682:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788568537.402696:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788568537.403846:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788568537.404074:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788568537.404079:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788568537.406300:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788568537.406312:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788568537.407478:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788568537.407634:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788568537.407640:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788568537.412959:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788568537.412972:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788568537.413767:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788568537.413987:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788568537.413993:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788568537.415133:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788568537.415143:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788568537.469265:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788568537.469473:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788568537.469486:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788568537.476565:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788568537.476580:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788568537.480661:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788568537.480678:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788568537.489813:0:5824:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788568537.489839:0:5824:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788568537.489844:0:5824:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.104@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788568537.490069:0:5824:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.104@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788568537.490101:0:5824:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.104@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1788568537.490106:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788568537.490107:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788568537.490108:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788568537.490109:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788568537.490110:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788568537.490112:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788568537.490113:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788568537.490114:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788568537.490116:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788568537.490117:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788568537.490118:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788568537.490120:0:5824:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788568537.490121:0:5824:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1788568537.490123:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788568537.490125:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788568537.490126:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788568537.490127:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788568537.490128:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788568537.490134:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788568537.490135:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788568537.490136:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788568537.490137:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788568537.490137:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788568537.490138:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788568537.490139:0:5824:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788568537.490181:0:5824:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788568537.490317:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fb6cd2ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:5824:1875449976193280:0@lo:253: 00000100:00100000:3.0:1788568537.490381:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568537.490479:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f7b9ae3b going to sleep for 11 seconds 00000100:00100000:0.0:1788568537.493831:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976193280 00000100:00100000:0.0:1788568537.493845:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976193280 00000100:00100000:0.0:1788568537.493913:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788568537.493921:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000082873aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+5:5824:x1875449976193280:12345-0@lo:253: 20000000:01000000:0.0:1788568537.494021:0:5835:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788568537.494024:0:5835:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1788568537.494775:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788568537.494894:0:5835:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1788568537.495325:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788568537.496862:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1788568537.501529:0:5835:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788568537.501536:0:5835:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1788568537.501541:0:5835:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1788568537.501544:0:5835:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1788568537.501574:0:5835:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1788568537.501835:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788568537.502267:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1788568537.502282:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788568537.502326:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1788568537.502369:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1788568537.502406:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1788568537.502499:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1788568537.502508:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1788568537.502568:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1788568537.502576:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1788568537.502606:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1788568537.502614:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1788568537.502643:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1788568537.502687:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1788568537.502717:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788568537.502722:0:5835:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1788568537.503136:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788568537.503362:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1788568537.503383:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788568537.503422:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1788568537.503457:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1788568537.503504:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1788568537.503516:0:5835:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1788568537.504064:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1788568537.504075:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788568537.504136:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1788568537.504177:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1788568537.504244:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1788568537.504257:0:5835:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1788568537.504348:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1788568537.504357:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1788568537.504391:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1788568537.504427:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1788568537.504637:0:5835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1788568537.504690:0:5835:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788568537.504697:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1788568537.505841:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1788568537.506372:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1788568537.506397:0:5835:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.104@tcp for mdt 20000000:01000000:3.0:1788568537.506399:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.104@tcp (null) (null) (null) 00000040:00080000:3.0:1788568537.506454:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1788568537.506463:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788568537.506494:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1788568537.506502:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.104@tcp (null) (null) 00000040:00080000:3.0:1788568537.506547:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1788568537.506558:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788568537.506609:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1788568537.506647:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1788568537.506708:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788568537.506711:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788568537.506720:0:5835:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788568537.506750:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788568537.506753:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788568537.506780:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788568537.506782:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788568537.513613:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1788568537.514124:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1788568537.514166:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1788568537.514193:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1788568537.514282:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788568537.514284:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788568537.522114:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1788568537.522585:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1788568537.522632:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1788568537.522697:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:3.0:1788568537.522710:0:5835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788568537.522713:0:5835:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1788568537.522717:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788568537.522720:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788568537.522725:0:5835:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788568537.522730:0:5835:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1788568537.523920:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1788568537.524127:0:5835:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1788568537.548657:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1788568537.548701:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1788568537.548786:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1788568537.548804:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788568537.548821:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000cf898705/0x41e82f464b6a0a3e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568537.548836:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cf898705/0x41e82f464b6a0a3e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568537.548844:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000cf898705/0x41e82f464b6a0a3e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568537.548864:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000cf898705/0x41e82f464b6a0a3e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568537.548870:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000cf898705/0x41e82f464b6a0a3e lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568537.548876:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000cf898705/0x41e82f464b6a0a3e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568537.548882:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cf898705 already unused, calling callback (0000000070f7c6a3) 00010000:00010000:0.0:1788568537.548885:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000cf898705/0x41e82f464b6a0a3e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568537.548891:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000cf898705/0x41e82f464b6a0a3e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568537.548901:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000cf898705/0x41e82f464b6a0a3e lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568537.548908:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000cf898705/0x41e82f464b6a0a3e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568537.548913:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cf898705/0x41e82f464b6a0a3e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788568537.549116:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788568537.939644:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000082873aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+5:5824:x1875449976193280:12345-0@lo:253: Request processed in 445717us (449256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568537.939662:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788568537.939987:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fb6cd2ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:5824:1875449976193280:0@lo:253: 10000000:01000000:0.0:1788568537.940003:0:5824:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788568537.940006:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788568537.940008:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788568537.940021:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788568537.940022:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1788568537.940024:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788568537.940025:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788568537.940026:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788568537.940027:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788568537.940028:0:5824:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788568537.940029:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788568537.940031:0:5824:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788568537.940048:0:5824:0:(tgt_mount.c:101:server_register_mount()) register mount 000000008f80f82c from lustre-MDT0000 10000000:01000000:0.0:1788568537.940071:0:5824:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788568537.940074:0:5824:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788568537.940078:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9ae26b2dcd40 10000000:01000000:0.0:1788568537.940082:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788568537.940090:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ae26b2dcd40 from 1 10000000:01000000:0.0:1788568537.940092:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788568537.940141:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: 00000000cf898705/0x41e82f464b6a0a45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568537.940151:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: 00000000cf898705/0x41e82f464b6a0a45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568537.940159:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: 00000000cf898705/0x41e82f464b6a0a45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568537.940175:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007a074a07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:5824:1875449976193408:0@lo:101: 00000100:00100000:0.0:1788568537.940239:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568537.940298:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 0000000072731d95 going to sleep for 11 seconds 00000100:00100000:1.0:1788568537.940435:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976193408 00000100:00100000:1.0:1788568537.940441:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976193408 00000100:00100000:1.0:1788568537.940478:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788568537.940486:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce2b807d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+5:5824:x1875449976193408:12345-0@lo:101: 00010000:00010000:1.0:1788568537.940498:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568537.940513:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004d1ae4e2/0x41e82f464b6a0a4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0a45 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568537.940534:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004d1ae4e2/0x41e82f464b6a0a4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0a45 expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568537.940544:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004d1ae4e2/0x41e82f464b6a0a4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0a45 expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568537.940570:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004d1ae4e2, rc 0) 00000100:00100000:1.0:1788568537.940608:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce2b807d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+6:5824:x1875449976193408:12345-0@lo:101: Request processed in 124us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568537.940615:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788568537.941600:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007a074a07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:5824:1875449976193408:0@lo:101: 00010000:00010000:0.0:1788568537.941619:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: 00000000cf898705/0x41e82f464b6a0a45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0a4c expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568537.941629:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: 00000000cf898705/0x41e82f464b6a0a45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0a4c expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568537.941694:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007a074a07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:5824:1875449976193536:0@lo:501: 00000100:00100000:0.0:1788568537.941840:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568537.941873:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 0000000072731d95 going to sleep for 11 seconds 00000100:00100000:3.0:1788568537.941970:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976193536 00000100:00100000:3.0:1788568537.941976:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976193536 00000100:00100000:3.0:1788568537.942003:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788568537.942009:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b77b3106 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+6:5824:x1875449976193536:12345-0@lo:501: 00000100:00100000:3.0:1788568537.942224:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b77b3106 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+6:5824:x1875449976193536:12345-0@lo:501: Request processed in 214us (383us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788568537.942232:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788568537.942483:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007a074a07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:5824:1875449976193536:0@lo:501: 10000000:01000000:0.0:1788568537.942507:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788568537.942531:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: 00000000cf898705/0x41e82f464b6a0a45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0a4c expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568537.942540:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: 00000000cf898705/0x41e82f464b6a0a45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0a4c expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568537.942548:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ae26b352000 10000000:01000000:0.0:1788568537.942552:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788568537.942556:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ae26b352000 10000000:01000000:0.0:1788568537.942559:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788568537.942561:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9ae26b352000 from 1 10000000:01000000:0.0:1788568537.942564:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788568537.942582:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: 000000009590e446/0x41e82f464b6a0a53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568537.942589:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: 000000009590e446/0x41e82f464b6a0a53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568537.942596:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: 000000009590e446/0x41e82f464b6a0a53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568537.942606:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007a074a07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:5824:1875449976193664:0@lo:101: 00000100:00100000:0.0:1788568537.942640:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568537.942667:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 0000000072731d95 going to sleep for 11 seconds 00000100:00100000:3.0:1788568537.943267:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976193664 00000100:00100000:3.0:1788568537.943274:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976193664 00000100:00100000:3.0:1788568537.943308:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788568537.943315:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009258ff03 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+6:5824:x1875449976193664:12345-0@lo:101: 00010000:00010000:3.0:1788568537.943325:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568537.943339:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a800482c/0x41e82f464b6a0a5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0a53 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568537.943358:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a800482c/0x41e82f464b6a0a5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0a53 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568537.943366:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a800482c/0x41e82f464b6a0a5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0a53 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568537.943373:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a800482c, rc 0) 00000100:00100000:3.0:1788568537.943408:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009258ff03 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+7:5824:x1875449976193664:12345-0@lo:101: Request processed in 94us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568537.943414:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788568537.943507:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007a074a07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:5824:1875449976193664:0@lo:101: 00010000:00010000:0.0:1788568537.943519:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: 000000009590e446/0x41e82f464b6a0a53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0a5a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568537.943526:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: 000000009590e446/0x41e82f464b6a0a53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0a5a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568537.943539:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788568537.943542:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: 000000009590e446/0x41e82f464b6a0a53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0a5a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568537.943547:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: 000000009590e446/0x41e82f464b6a0a53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0a5a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568537.943553:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788568537.943556:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788568537.943560:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ae26b352000 10000000:01000000:0.0:1788568537.943562:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788568537.943564:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788568537.943566:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788568537.943580:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: 00000000ebd48e69/0x41e82f464b6a0a61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568537.943586:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: 00000000ebd48e69/0x41e82f464b6a0a61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568537.943592:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: 00000000ebd48e69/0x41e82f464b6a0a61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568537.943615:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007a074a07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:5824:1875449976193792:0@lo:101: 00000100:00100000:0.0:1788568537.943646:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568537.943672:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 0000000072731d95 going to sleep for 11 seconds 00000100:00100000:1.0:1788568537.943677:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976193792 00000100:00100000:1.0:1788568537.943682:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976193792 00000100:00100000:1.0:1788568537.943717:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788568537.943723:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed626d0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+7:5824:x1875449976193792:12345-0@lo:101: 00010000:00010000:1.0:1788568537.943730:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568537.943738:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f8b49c84/0x41e82f464b6a0a68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0a61 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568537.943750:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f8b49c84/0x41e82f464b6a0a68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0a61 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568537.943758:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f8b49c84/0x41e82f464b6a0a68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0a61 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568537.943764:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f8b49c84, rc 0) 00000100:00100000:1.0:1788568537.943791:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed626d0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+8:5824:x1875449976193792:12345-0@lo:101: Request processed in 69us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568537.943796:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788568537.943848:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007a074a07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:5824:1875449976193792:0@lo:101: 00010000:00010000:0.0:1788568537.943857:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: 00000000ebd48e69/0x41e82f464b6a0a61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0a68 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568537.943863:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: 00000000ebd48e69/0x41e82f464b6a0a61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0a68 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568537.943900:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007a074a07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:5824:1875449976193920:0@lo:501: 00000100:00100000:0.0:1788568537.944020:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568537.944037:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 0000000072731d95 going to sleep for 11 seconds 00000100:00100000:3.0:1788568537.944087:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976193920 00000100:00100000:3.0:1788568537.944092:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976193920 00000100:00100000:3.0:1788568537.944118:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788568537.944124:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a251933b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+8:5824:x1875449976193920:12345-0@lo:501: 00000100:00100000:3.0:1788568537.944333:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a251933b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+9:5824:x1875449976193920:12345-0@lo:501: Request processed in 209us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568537.944339:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788568537.944586:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007a074a07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:5824:1875449976193920:0@lo:501: 00000100:00100000:0.0:1788568537.944613:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007a074a07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:5824:1875449976194048:0@lo:503: 00000100:00100000:0.0:1788568537.944647:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568537.944665:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 0000000072731d95 going to sleep for 11 seconds 00000100:00100000:1.0:1788568537.944840:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976194048 00000100:00100000:1.0:1788568537.944847:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976194048 00000100:00100000:1.0:1788568537.944875:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788568537.944881:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef59c635 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+9:5824:x1875449976194048:12345-0@lo:503: 00000100:00100000:1.0:1788568537.945125:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef59c635 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+9:5824:x1875449976194048:12345-0@lo:503: Request processed in 244us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568537.945137:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788568537.945274:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007a074a07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:5824:1875449976194048:0@lo:503: 00000100:00100000:3.0:1788568537.951138:0:5866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ee43ad86 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:5866:1875449976194176:0@lo:502: 00000100:00100000:3.0:1788568537.951637:0:5866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568537.951763:0:5866:0:(client.c:2716:ptlrpc_set_wait()) set 0000000090094298 going to sleep for 11 seconds 00000100:00100000:1.0:1788568537.952071:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976194176 00000100:00100000:1.0:1788568537.952079:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976194176 00000100:00100000:1.0:1788568537.952157:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788568537.952166:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000047b8f761 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+9:5866:x1875449976194176:12345-0@lo:502: 00000100:00100000:1.0:1788568537.952412:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000047b8f761 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+9:5866:x1875449976194176:12345-0@lo:502: Request processed in 246us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568537.952422:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788568537.952508:0:5866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ee43ad86 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:5866:1875449976194176:0@lo:502: 00000020:01000000:3.0:1788568537.952542:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788568537.952552:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788568537.952554:0:5866:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788568537.952570:0:5866:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788568537.952573:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788568537.952584:0:5866:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000090f77b48) 00000020:00000080:3.0:1788568537.952599:0:5866:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788568537.952605:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788568537.952676:0:5866:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788568537.952683:0:5866:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x41e82f464b6a0a76 00000020:00000080:3.0:1788568537.952918:0:5866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788568537.952922:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788568537.953020:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788568537.953022:0:5866:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788568537.953026:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788568537.953029:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788568537.953030:0:5866:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788568537.953033:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788568537.953658:0:5866:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000024f2451b) 00000020:00000080:3.0:1788568537.953675:0:5866:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788568537.953683:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788568537.953685:0:5866:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788568537.953687:0:5866:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788568537.953692:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788568537.953744:0:5866:0:(tgt_mount.c:153:server_get_mount()) get mount 000000008f80f82c from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788568537.953754:0:5866:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000557217ad) 00000020:00000080:3.0:1788568537.953762:0:5866:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788568537.953804:0:5866:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788568537.953809:0:5866:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x41e82f464b6a0a8b 00000020:00000080:3.0:1788568537.957086:0:5866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788568537.957123:0:5866:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788568537.957137:0:5866:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x41e82f464b6a0a92 00080000:01000000:3.0:1788568537.957146:0:5866:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788568537.957163:0:5866:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x41e82f464b6a0a99 00080000:10000000:3.0:1788568537.957577:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1788568537.959973:0:5866:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1788568537.974287:0:5866:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1788568538.194338:0:5866:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1788568538.194679:0:5866:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1788568538.211090:0:5866:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1788568538.211432:0:5866:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00010000:0.0:1788568538.231147:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788568538.314714:0:5866:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000003e899977) 00000020:00000080:1.0:1788568538.314735:0:5866:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788568538.316296:0:5866:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788568538.316328:0:5866:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x41e82f464b6a0aa7 00000020:00000080:3.0:1788568538.334486:0:5866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1788568538.338339:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788568538.473783:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788568538.513576:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788568538.564225:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788568538.640892:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788568538.723024:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1788568538.768501:0:5866:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x41e82f464b6a0aae 00000020:00000080:0.0:1788568538.769312:0:5866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788568538.769323:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788568538.769330:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788568538.769332:0:5866:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788568538.769336:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788568538.769340:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788568538.769346:0:5866:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788568538.769350:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788568538.769352:0:5866:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788568538.769354:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788568538.769357:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788568538.769358:0:5866:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788568538.769360:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788568538.769364:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788568538.769365:0:5866:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788568538.769369:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788568538.769407:0:5866:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1788568538.769460:0:5866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b7cbe75e pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:5866:1875449976194304:0@lo:502: 00000100:00100000:0.0:1788568538.769535:0:5866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568538.769578:0:5866:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d7e22dcd going to sleep for 11 seconds 00000100:00100000:3.0:1788568538.769702:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976194304 00000100:00100000:3.0:1788568538.769709:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976194304 00000100:00100000:3.0:1788568538.769761:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788568538.769770:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000077c4f62e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+9:5866:x1875449976194304:12345-0@lo:502: 00000100:00100000:3.0:1788568538.770320:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000077c4f62e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+9:5866:x1875449976194304:12345-0@lo:502: Request processed in 550us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568538.770329:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788568538.770380:0:5866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b7cbe75e pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:5866:1875449976194304:0@lo:502: 00000020:01000000:3.0:1788568538.770407:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788568538.770413:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788568538.770415:0:5866:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1788568538.770418:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1788568538.770525:0:5824:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1788568538.770542:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788568538.770555:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: 00000000ebd48e69/0x41e82f464b6a0a61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0a68 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568538.770566:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: 00000000ebd48e69/0x41e82f464b6a0a61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0a68 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788568538.770574:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ae26b352000 from 1 10000000:01000000:3.0:1788568538.770577:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788568538.770601:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: 00000000a1b372bc/0x41e82f464b6a0ab5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568538.770616:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: 00000000a1b372bc/0x41e82f464b6a0ab5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568538.770623:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: 00000000a1b372bc/0x41e82f464b6a0ab5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568538.770638:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ee43ad86 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:5824:1875449976194432:0@lo:101: 00000100:00100000:3.0:1788568538.770669:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568538.770692:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 000000005cb16f96 going to sleep for 11 seconds 00000100:00100000:0.0:1788568538.770868:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976194432 00000100:00100000:0.0:1788568538.770874:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976194432 00000100:00100000:0.0:1788568538.770908:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788568538.770915:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1a1698f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+9:5824:x1875449976194432:12345-0@lo:101: 00010000:00010000:0.0:1788568538.770948:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568538.771077:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bd8f02d7/0x41e82f464b6a0abc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0ab5 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568538.771100:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bd8f02d7/0x41e82f464b6a0abc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0ab5 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568538.771108:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bd8f02d7/0x41e82f464b6a0abc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0ab5 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568538.771114:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bd8f02d7, rc 0) 00000100:00100000:0.0:1788568538.771140:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1a1698f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+10:5824:x1875449976194432:12345-0@lo:101: Request processed in 226us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568538.771153:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788568538.771381:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ee43ad86 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:5824:1875449976194432:0@lo:101: 00010000:00010000:3.0:1788568538.771393:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: 00000000a1b372bc/0x41e82f464b6a0ab5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0abc expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568538.771401:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: 00000000a1b372bc/0x41e82f464b6a0ab5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0abc expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568538.772340:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ee43ad86 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:5824:1875449976194560:0@lo:256: 00000100:00100000:3.0:1788568538.772386:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568538.772458:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 000000005cb16f96 going to sleep for 11 seconds 00000100:00100000:0.0:1788568538.772577:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976194560 00000100:00100000:0.0:1788568538.772584:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976194560 00000100:00100000:0.0:1788568538.772625:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788568538.772633:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a86a005 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+10:5824:x1875449976194560:12345-0@lo:256: 20000000:01000000:0.0:1788568538.772647:0:5835:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788568538.772652:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788568538.772728:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a86a005 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+10:5824:x1875449976194560:12345-0@lo:256: Request processed in 96us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568538.772735:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788568538.772880:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ee43ad86 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:5824:1875449976194560:0@lo:256: 10000000:01000000:2.0:1788568538.773512:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788568538.773534:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: 00000000a1b372bc/0x41e82f464b6a0ab5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0abc expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568538.773543:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: 00000000a1b372bc/0x41e82f464b6a0ab5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0abc expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788568538.773558:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae26b352000 from 1 10000000:01000000:2.0:1788568538.773561:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788568538.773599:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: 000000007dbf13f1/0x41e82f464b6a0ac3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568538.773606:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: 000000007dbf13f1/0x41e82f464b6a0ac3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568538.773613:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: 000000007dbf13f1/0x41e82f464b6a0ac3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568538.773627:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000afda5c24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:5824:1875449976194688:0@lo:101: 00000100:00100000:2.0:1788568538.773671:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568538.773687:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 00000000eded1df8 going to sleep for 11 seconds 00000100:00100000:0.0:1788568538.773974:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976194688 00000100:00100000:0.0:1788568538.773980:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976194688 00000100:00100000:0.0:1788568538.774006:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788568538.774012:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b805de3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+10:5824:x1875449976194688:12345-0@lo:101: 00010000:00010000:0.0:1788568538.774022:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568538.774033:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bc3ca3d0/0x41e82f464b6a0aca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0ac3 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568538.774052:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bc3ca3d0/0x41e82f464b6a0aca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0ac3 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568538.774061:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bc3ca3d0/0x41e82f464b6a0aca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0ac3 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568538.774068:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bc3ca3d0, rc 0) 00000100:00100000:0.0:1788568538.774108:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b805de3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+11:5824:x1875449976194688:12345-0@lo:101: Request processed in 96us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568538.774114:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788568538.774489:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000afda5c24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:5824:1875449976194688:0@lo:101: 00010000:00010000:2.0:1788568538.774502:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: 000000007dbf13f1/0x41e82f464b6a0ac3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0aca expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568538.774511:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: 000000007dbf13f1/0x41e82f464b6a0ac3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0aca expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568538.774558:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000afda5c24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:5824:1875449976194816:0@lo:501: 00000100:00100000:2.0:1788568538.774582:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568538.774612:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 00000000eded1df8 going to sleep for 11 seconds 00000100:00100000:0.0:1788568538.774664:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976194816 00000100:00100000:0.0:1788568538.774668:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976194816 00000100:00100000:0.0:1788568538.774685:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788568538.774690:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f318fc38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+11:5824:x1875449976194816:12345-0@lo:501: 00000100:00100000:0.0:1788568538.775558:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f318fc38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+11:5824:x1875449976194816:12345-0@lo:501: Request processed in 865us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568538.775567:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788568538.775831:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000afda5c24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:5824:1875449976194816:0@lo:501: 00000100:00100000:2.0:1788568538.775867:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000afda5c24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:5824:1875449976194944:0@lo:503: 00000100:00100000:2.0:1788568538.775913:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568538.776189:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 00000000eded1df8 going to sleep for 11 seconds 00000100:00100000:0.0:1788568538.776321:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976194944 00000100:00100000:0.0:1788568538.776326:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976194944 00000100:00100000:0.0:1788568538.776397:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788568538.776404:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c283bdb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+11:5824:x1875449976194944:12345-0@lo:503: 00000040:00080000:0.0:1788568538.776441:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788568538.776530:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c283bdb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+11:5824:x1875449976194944:12345-0@lo:503: Request processed in 127us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568538.776536:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788568538.776629:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000afda5c24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:5824:1875449976194944:0@lo:503: 00000040:00080000:2.0:1788568538.777912:0:5870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1788568538.778427:0:5824:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788568538.778447:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788568538.778498:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: 000000007dbf13f1/0x41e82f464b6a0ac3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0aca expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568538.778510:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: 000000007dbf13f1/0x41e82f464b6a0ac3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0aca expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788568538.778564:0:5824:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788568538.778566:0:5824:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ae26b352000 10000000:01000000:3.0:1788568538.778568:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ae26b352000 10000000:01000000:3.0:1788568538.778572:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788568538.778576:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ae26b352000 from 1 10000000:01000000:3.0:1788568538.778579:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788568538.778608:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: 000000007fcd8449/0x41e82f464b6a0ad1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568538.778615:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: 000000007fcd8449/0x41e82f464b6a0ad1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568538.778623:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: 000000007fcd8449/0x41e82f464b6a0ad1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568538.778643:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b6c12aa7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:5824:1875449976195072:0@lo:101: 00000100:00100000:3.0:1788568538.778695:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568538.778840:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 00000000956c3bdb going to sleep for 11 seconds 00000100:00100000:1.0:1788568538.778873:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976195072 00000100:00100000:1.0:1788568538.778880:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976195072 00000100:00100000:1.0:1788568538.779048:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788568538.779056:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068130361 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+11:5824:x1875449976195072:12345-0@lo:101: 00010000:00010000:1.0:1788568538.779067:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568538.779077:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d69c4efa/0x41e82f464b6a0ad8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0ad1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568538.779095:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d69c4efa/0x41e82f464b6a0ad8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0ad1 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568538.779111:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d69c4efa/0x41e82f464b6a0ad8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0ad1 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568538.779118:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d69c4efa, rc 0) 00000100:00100000:1.0:1788568538.779153:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068130361 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+12:5824:x1875449976195072:12345-0@lo:101: Request processed in 98us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568538.779159:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788568538.779315:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b6c12aa7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:5824:1875449976195072:0@lo:101: 00010000:00010000:3.0:1788568538.779327:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: 000000007fcd8449/0x41e82f464b6a0ad1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0ad8 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568538.779336:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: 000000007fcd8449/0x41e82f464b6a0ad1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0ad8 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568538.779380:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b6c12aa7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:5824:1875449976195200:0@lo:501: 00000100:00100000:3.0:1788568538.779405:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568538.779655:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 00000000956c3bdb going to sleep for 11 seconds 00000100:00100000:2.0:1788568538.779723:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976195200 00000100:00100000:2.0:1788568538.779728:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976195200 00000100:00100000:2.0:1788568538.779770:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788568538.779777:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086546ed6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+12:5824:x1875449976195200:12345-0@lo:501: 00000100:00100000:2.0:1788568538.780035:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086546ed6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+12:5824:x1875449976195200:12345-0@lo:501: Request processed in 259us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568538.780043:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788568538.780249:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b6c12aa7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:5824:1875449976195200:0@lo:501: 00000100:00100000:3.0:1788568538.780290:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b6c12aa7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:5824:1875449976195328:0@lo:503: 00000100:00100000:3.0:1788568538.780329:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568538.780357:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 00000000956c3bdb going to sleep for 11 seconds 00000100:00100000:2.0:1788568538.780503:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976195328 00000100:00100000:2.0:1788568538.780509:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976195328 00000100:00100000:2.0:1788568538.780528:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788568538.780533:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de2c00c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+12:5824:x1875449976195328:12345-0@lo:503: 00000100:00100000:2.0:1788568538.780785:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de2c00c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+12:5824:x1875449976195328:12345-0@lo:503: Request processed in 251us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568538.780792:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788568538.780913:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b6c12aa7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:5824:1875449976195328:0@lo:503: 00000100:00100000:3.0:1788568538.781463:0:5871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b6c12aa7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:5871:1875449976195456:0@lo:502: 00000100:00100000:3.0:1788568538.781510:0:5871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568538.781543:0:5871:0:(client.c:2716:ptlrpc_set_wait()) set 000000005cb16f96 going to sleep for 11 seconds 00000100:00100000:2.0:1788568538.781586:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976195456 00000100:00100000:2.0:1788568538.781592:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976195456 00000100:00100000:2.0:1788568538.781616:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788568538.781622:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000018fab0a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+12:5871:x1875449976195456:12345-0@lo:502: 00000100:00100000:2.0:1788568538.781841:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000018fab0a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+12:5871:x1875449976195456:12345-0@lo:502: Request processed in 219us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568538.781849:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788568538.782153:0:5871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b6c12aa7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:5871:1875449976195456:0@lo:502: 00000020:01000004:3.0:1788568538.782220:0:5871:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788568538.782234:0:5871:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000e1be3156) 00000020:00000080:3.0:1788568538.782250:0:5871:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1788568538.782396:0:5871:0:(tgt_mount.c:153:server_get_mount()) get mount 000000008f80f82c from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788568538.782400:0:5871:0:(tgt_mount.c:187:server_put_mount()) put mount 000000008f80f82c from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788568538.782403:0:5871:0:(obd_mount.c:710:lustre_put_lsi()) put 000000008f80f82c 4 00010000:00080000:3.0:1788568538.782440:0:5871:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000bb0e6fd1@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.104@tcp at head 00010000:00010000:3.0:1788568538.784823:0:5871:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788568538.785187:0:5871:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788568538.785230:0:5871:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788568538.785241:0:5871:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x41e82f464b6a0ae6 00000100:00080000:3.0:1788568538.785251:0:5871:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788568538.785255:0:5871:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000bb0e6fd1 using connection 192.168.206.104@tcp/0@lo 00000100:00100000:3.0:1788568538.785420:0:5871:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b6c12aa7 x1875449976195584/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788568538.785453:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b6c12aa7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875449976195584:0@lo:38: 00000100:00100000:3.0:1788568538.785522:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568538.785584:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976195584 00000100:00100000:3.0:1788568538.785592:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976195584 00000100:00100000:3.0:1788568538.785619:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788568538.785625:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc92bd21 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1875449976195584:12345-0@lo:38: 00000100:00100000:3.0:1788568538.785672:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc92bd21 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1875449976195584:12345-0@lo:38: Request processed in 47us (150us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788568538.785679:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788568538.785713:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788568538.785719:0:3305:0:(import.c:65:import_set_state_nolock()) 00000000bb0e6fd1 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788568538.785731:0:3305:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788568538.785734:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b6c12aa7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875449976195584:0@lo:38: 00000100:00080000:3.0:1788568538.785904:0:5871:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788568538.789230:0:5871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000afda5c24 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:5871:1875449976195712:0@lo:502: 00000100:00100000:2.0:1788568538.789321:0:5871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568538.789366:0:5871:0:(client.c:2716:ptlrpc_set_wait()) set 000000005e703d3b going to sleep for 11 seconds 00000100:00100000:0.0:1788568538.789470:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976195712 00000100:00100000:0.0:1788568538.789478:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976195712 00000100:00100000:0.0:1788568538.789524:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788568538.789531:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0eeb1fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+12:5871:x1875449976195712:12345-0@lo:502: 00000100:00100000:0.0:1788568538.789737:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0eeb1fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+12:5871:x1875449976195712:12345-0@lo:502: Request processed in 206us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568538.789744:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788568538.789801:0:5871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000afda5c24 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:5871:1875449976195712:0@lo:502: 00000040:00080000:0.0:1788568538.789827:0:5871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1788568538.792099:0:5824:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788568538.792126:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788568538.792147:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: 000000007fcd8449/0x41e82f464b6a0ad1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0ad8 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568538.792159:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: 000000007fcd8449/0x41e82f464b6a0ad1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0ad8 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788568538.792218:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788568538.792221:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788568538.792222:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788568538.792224:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788568538.792225:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788568538.792226:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788568538.792228:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788568538.792229:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788568538.792230:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788568538.792231:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788568538.792233:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788568538.792234:0:5824:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788568538.792238:0:5824:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1788568538.792240:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788568538.792241:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788568538.792242:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788568538.792243:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788568538.792244:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788568538.792245:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788568538.792246:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788568538.792247:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788568538.792248:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788568538.792249:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788568538.792250:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788568538.792251:0:5824:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788568538.792291:0:5824:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788568538.792312:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000db937217 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:5824:1875449976195840:0@lo:253: 00000100:00100000:2.0:1788568538.792371:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568538.792402:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 000000002d6ad9e8 going to sleep for 11 seconds 00000100:00100000:0.0:1788568538.792580:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976195840 00000100:00100000:0.0:1788568538.792589:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976195840 00000100:00100000:0.0:1788568538.792637:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788568538.792645:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1233741 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+12:5824:x1875449976195840:12345-0@lo:253: 20000000:01000000:0.0:1788568538.792676:0:5835:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788568538.792687:0:5835:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788568538.833509:0:5835:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788568538.833527:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788568538.833622:0:5858:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788568538.833627:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788568538.833645:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c0b2aa0d/0x41e82f464b6a0aed lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568538.833661:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000bd8f02d7/0x41e82f464b6a0abc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0ab5 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568538.833667:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c0b2aa0d/0x41e82f464b6a0aed lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568538.833701:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000bd8f02d7/0x41e82f464b6a0abc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x41e82f464b6a0ab5 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568538.833715:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000bd8f02d7/0x41e82f464b6a0abc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x41e82f464b6a0ab5 expref: 12 pid: 5835 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568538.833726:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d39c479e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1875449976195968:0@lo:104: 00000100:00100000:2.0:1788568538.833782:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568538.833839:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set 00000000628f5b39 going to sleep for 11 seconds 00000100:00100000:3.0:1788568538.833902:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976195968 00000100:00100000:3.0:1788568538.833910:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976195968 00000100:00100000:3.0:1788568538.834075:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788568538.834084:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ffd83f5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:925db6b8-84bc-418c-b37a-40345c1020be+3:5858:x1875449976195968:12345-0@lo:104: 00010000:00010000:3.0:1788568538.834095:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.104@tcp lock: 00000000a1b372bc/0x41e82f464b6a0ab5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0abc expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568538.834147:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788568538.834152:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ffd83f5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:925db6b8-84bc-418c-b37a-40345c1020be+3:5858:x1875449976195968:12345-0@lo:104: Request processed in 71us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568538.834159:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788568538.834180:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788568538.834185:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: 00000000a1b372bc/0x41e82f464b6a0ab5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0abc expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568538.834222:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a1b372bc already unused, calling callback (0000000017135fc7) 10000000:00010000:3.0:1788568538.834225:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: 00000000a1b372bc/0x41e82f464b6a0ab5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x41e82f464b6a0abc expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568538.834231:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: 00000000a1b372bc/0x41e82f464b6a0ab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x41e82f464b6a0abc expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788568538.834237:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: 00000000a1b372bc/0x41e82f464b6a0ab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x41e82f464b6a0abc expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788568538.834242:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788568538.834267:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: 00000000a1b372bc/0x41e82f464b6a0ab5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0abc expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568538.834273:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788568538.834288:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: 00000000a1b372bc/0x41e82f464b6a0ab5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0abc expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568538.834293:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: 00000000a1b372bc/0x41e82f464b6a0ab5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0abc expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568538.834308:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568538.834310:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568538.834311:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568538.834397:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b6c12aa7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925db6b8-84bc-418c-b37a-40345c1020be:3307:1875449976196096:0@lo:103: 00000100:00100000:3.0:1788568538.834425:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568538.834501:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d39c479e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1875449976195968:0@lo:104: 00010000:00010000:3.0:1788568538.834518:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c0b2aa0d/0x41e82f464b6a0aed lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568538.837153:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976196096 00000100:00100000:0.0:1788568538.837168:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976196096 00010000:00010000:0.0:1788568538.837216:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000bd8f02d7/0x41e82f464b6a0abc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0ab5 expref: 13 pid: 5835 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568538.837254:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788568538.837262:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000091a67fa8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:925db6b8-84bc-418c-b37a-40345c1020be+13:3307:x1875449976196096:12345-0@lo:103: 00010000:00010000:0.0:1788568538.837275:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568538.837279:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000bd8f02d7/0x41e82f464b6a0abc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0ab5 expref: 13 pid: 5835 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568538.837289:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000bd8f02d7/0x41e82f464b6a0abc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x41e82f464b6a0ab5 expref: 13 pid: 5835 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568538.837303:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bd8f02d7/0x41e82f464b6a0abc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x41e82f464b6a0ab5 expref: 13 pid: 5835 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568538.837318:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c0b2aa0d/0x41e82f464b6a0aed lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568538.837325:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c0b2aa0d/0x41e82f464b6a0aed lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788568538.837339:0:5827:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003713446s 00010000:00010000:0.0:1788568538.837343:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c0b2aa0d/0x41e82f464b6a0aed lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568538.837363:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c0b2aa0d/0x41e82f464b6a0aed lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568538.837369:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c0b2aa0d/0x41e82f464b6a0aed lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568538.837375:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c0b2aa0d/0x41e82f464b6a0aed lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568538.837381:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c0b2aa0d already unused, calling callback (0000000070f7c6a3) 00010000:00010000:0.0:1788568538.837384:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c0b2aa0d/0x41e82f464b6a0aed lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568538.837391:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c0b2aa0d/0x41e82f464b6a0aed lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568538.837405:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c0b2aa0d/0x41e82f464b6a0aed lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568538.837416:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788568538.837477:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000091a67fa8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:925db6b8-84bc-418c-b37a-40345c1020be+12:3307:x1875449976196096:12345-0@lo:103: Request processed in 216us (3051us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568538.837484:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788568538.837915:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b6c12aa7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925db6b8-84bc-418c-b37a-40345c1020be:3307:1875449976196096:0@lo:103: 00010000:00010000:3.0:1788568538.837994:0:5858:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c0b2aa0d/0x41e82f464b6a0aed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568538.838002:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c0b2aa0d/0x41e82f464b6a0aed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568538.838008:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c0b2aa0d/0x41e82f464b6a0aed lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568538.842551:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1233741 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+11:5824:x1875449976195840:12345-0@lo:253: Request processed in 49901us (50174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568538.842565:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788568538.842656:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000db937217 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:5824:1875449976195840:0@lo:253: 10000000:01000000:2.0:1788568538.842670:0:5824:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788568538.842673:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788568538.842675:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788568538.842676:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788568538.842677:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788568538.842678:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788568538.842679:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788568538.842680:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788568538.842694:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788568538.842695:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788568538.842696:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788568538.842698:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788568538.842699:0:5824:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788568538.842712:0:5824:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788568538.846719:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788568538.847324:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788568538.847540:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788568538.847716:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788568538.848294:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788568538.848500:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788568538.851550:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788568538.851785:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788568538.852145:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788568538.852341:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788568538.852560:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788568538.852725:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1788568538.919016:0:5824:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1788568538.945964:0:5824:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1788568538.946326:0:5877:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788568538.952693:0:5824:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788568538.953625:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1788568538.953708:0:5876:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1788568538.953712:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000004:00000080:1.0:1788568538.954536:0:5824:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788568538.954549:0:5824:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788568538.954731:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788568538.955699:0:5824:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788568538.956275:0:5824:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788568538.956303:0:5824:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788568538.956507:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788568538.956694:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1788568538.966632:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788568538.967060:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788568538.967223:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788568538.967391:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788568538.967533:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788568538.967692:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788568538.970671:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788568538.971164:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788568538.971328:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788568538.971789:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1788568538.972322:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1788568538.972521:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1788568538.972656:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1788568538.972832:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1788568538.973103:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1788568538.973272:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1788568538.973890:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1788568538.974280:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788568538.974423:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788568538.974584:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1788568538.974726:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788568538.975351:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1788568538.975471:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788568538.975612:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788568538.975731:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788568538.975884:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788568538.976049:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788568538.976463:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788568538.976630:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788568538.976803:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788568538.977127:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788568538.977363:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1788568538.977560:0:5824:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1788568538.999873:0:5877:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1788568539.064346:0:5824:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788568539.064378:0:5824:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbd7901cd3988 00100000:10000000:1.0:1788568539.064384:0:5824:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788568539.067572:0:5824:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788568539.067587:0:5824:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.104@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788568539.067600:0:5824:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788568539.067621:0:5824:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1788568539.127660:0:5877:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788568539.127732:0:5877:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:2.0:1788568539.127736:0:5877:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1788568539.256089:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568540.289357:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568541.303149:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568542.327101:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568543.351162:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788568543.873736:0:6120:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg604-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788568544.248989:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cda3ff32 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:925db6b8-84bc-418c-b37a-40345c1020be:3308:1875449976196224:0@lo:400: 00000100:00100000:2.0:1788568544.249070:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788568544.249076:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788568544.249080:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788568544.249083:0:38:0:(import.c:65:import_set_state_nolock()) 00000000bb0e6fd1 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788568544.249096:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000bb0e6fd1 using connection 192.168.206.104@tcp/0@lo 00000100:00100000:1.0:1788568544.249116:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ddcda1b7 x1875449976196352/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788568544.249156:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976196224 00000100:00100000:2.0:1788568544.249163:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976196224 00000100:00100000:3.0:1788568544.249213:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ddcda1b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875449976196352:0@lo:38: 00000100:00100000:2.0:1788568544.249227:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788568544.249237:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b4c08207 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+11:3308:x1875449976196224:12345-0@lo:400: 00000100:00100000:3.0:1788568544.249252:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568544.249291:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b4c08207 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+11:3308:x1875449976196224:12345-0@lo:400: Request processed in 55us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568544.249307:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788568544.249348:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cda3ff32 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:925db6b8-84bc-418c-b37a-40345c1020be:3308:1875449976196224:0@lo:400: 00000100:00100000:1.0:1788568544.249435:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976196352 00000100:00100000:1.0:1788568544.249439:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976196352 00000100:00100000:1.0:1788568544.249536:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788568544.249541:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6c12aa7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1875449976196352:12345-0@lo:38: 00010000:00080000:1.0:1788568544.249562:0:5844:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 178 last 0 00000020:00000080:1.0:1788568544.249596:0:5844:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x41e82f464b6a0af4 00000004:00100000:1.0:1788568544.249636:0:5844:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788568544.249752:0:5844:0:(import.c:65:import_set_state_nolock()) 00000000a61d2748 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788568544.249846:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6c12aa7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875449976196352:12345-0@lo:38: Request processed in 303us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568544.249853:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788568544.249855:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ddcda1b7 x1875449976196352/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788568554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788568544.249866:0:3305:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788568544.249872:0:3305:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788568544.249876:0:3305:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788568544.249878:0:3305:0:(import.c:65:import_set_state_nolock()) 00000000bb0e6fd1 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788568544.249883:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ddcda1b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875449976196352:0@lo:38: 00010000:00010000:2.0:1788568544.379983:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568545.401480:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568546.424612:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788568546.807769:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788568546.807777:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ae26b352000 from 3 10000000:01000000:1.0:1788568546.807782:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788568546.807830:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: 000000006500a370/0x41e82f464b6a0afb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568546.807841:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: 000000006500a370/0x41e82f464b6a0afb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568546.807850:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: 000000006500a370/0x41e82f464b6a0afb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568546.807872:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000007855e1d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976196480:0@lo:101: 00000100:00100000:1.0:1788568546.807984:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568546.808042:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e7cc3cb7 going to sleep for 11 seconds 00000100:00100000:2.0:1788568546.808122:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976196480 00000100:00100000:2.0:1788568546.808129:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976196480 00000100:00100000:2.0:1788568546.808186:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788568546.808194:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c0c0cba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+11:5838:x1875449976196480:12345-0@lo:101: 00010000:00010000:2.0:1788568546.808206:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568546.808218:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e9dc0ca0/0x41e82f464b6a0b02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0afb expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568546.808240:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e9dc0ca0/0x41e82f464b6a0b02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0afb expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568546.808250:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e9dc0ca0/0x41e82f464b6a0b02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0afb expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568546.808258:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e9dc0ca0, rc 0) 00000100:00100000:2.0:1788568546.808303:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c0c0cba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+12:5838:x1875449976196480:12345-0@lo:101: Request processed in 110us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568546.808310:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788568546.808677:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000007855e1d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976196480:0@lo:101: 00010000:00010000:1.0:1788568546.808692:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: 000000006500a370/0x41e82f464b6a0afb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0b02 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568546.808701:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: 000000006500a370/0x41e82f464b6a0afb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0b02 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568546.808761:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000007855e1d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976196608:0@lo:256: 00000100:00100000:1.0:1788568546.808794:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568546.808822:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e7cc3cb7 going to sleep for 11 seconds 00000100:00100000:2.0:1788568546.809046:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976196608 00000100:00100000:2.0:1788568546.809052:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976196608 00000100:00100000:2.0:1788568546.809077:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788568546.809084:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee6180f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+12:5838:x1875449976196608:12345-0@lo:256: 20000000:01000000:2.0:1788568546.809097:0:5834:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788568546.809110:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788568546.809113:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788568546.809213:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee6180f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+12:5838:x1875449976196608:12345-0@lo:256: Request processed in 128us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568546.809220:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788568546.809292:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000007855e1d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976196608:0@lo:256: 10000000:01000000:3.0:1788568546.809331:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788568546.809338:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: 000000006500a370/0x41e82f464b6a0afb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0b02 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568546.809345:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: 000000006500a370/0x41e82f464b6a0afb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0b02 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568547.448038:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568548.477370:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788568548.875022:0:6322:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc63784270 20000000:00000080:0.0:1788568548.875037:0:6322:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ae27cc97c00 uarg=0000000000000000 20000000:01000000:0.0:1788568548.875067:0:6322:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788568548.875073:0:6322:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788568548.875082:0:6322:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788568548.875364:0:6322:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1788568548.875374:0:6322:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1788568548.879507:0:6322:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788568548.879735:0:6322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788568548.879855:0:6322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1788568548.880022:0:6322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1788568548.880039:0:6322:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788568548.880053:0:6322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000006368d17/0x41e82f464b6a0b09 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568548.880068:0:6322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000bc3ca3d0/0x41e82f464b6a0aca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0ac3 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568548.880074:0:6322:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000006368d17/0x41e82f464b6a0b09 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568548.880109:0:6322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000bc3ca3d0/0x41e82f464b6a0aca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x41e82f464b6a0ac3 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568548.880123:0:6322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000bc3ca3d0/0x41e82f464b6a0aca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x41e82f464b6a0ac3 expref: 11 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568548.880135:0:6322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ba112368 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6322:1875449976196736:0@lo:104: 00000100:00100000:0.0:1788568548.880346:0:6322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568548.880390:0:6322:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b80e568a going to sleep for 11 seconds 00000100:00100000:2.0:1788568548.881030:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976196736 00000100:00100000:2.0:1788568548.881038:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976196736 00000100:00100000:2.0:1788568548.881081:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788568548.881089:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ccb01c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:925db6b8-84bc-418c-b37a-40345c1020be+3:6322:x1875449976196736:12345-0@lo:104: 00010000:00010000:2.0:1788568548.881101:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.104@tcp lock: 000000007dbf13f1/0x41e82f464b6a0ac3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0aca expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568548.881176:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788568548.881181:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ccb01c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:925db6b8-84bc-418c-b37a-40345c1020be+3:6322:x1875449976196736:12345-0@lo:104: Request processed in 93us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568548.881188:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788568548.881208:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788568548.881212:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: 000000007dbf13f1/0x41e82f464b6a0ac3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0aca expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568548.881219:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007dbf13f1 already unused, calling callback (0000000017135fc7) 10000000:00010000:2.0:1788568548.881221:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: 000000007dbf13f1/0x41e82f464b6a0ac3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x41e82f464b6a0aca expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568548.881229:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: 000000007dbf13f1/0x41e82f464b6a0ac3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x41e82f464b6a0aca expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788568548.881234:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: 000000007dbf13f1/0x41e82f464b6a0ac3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x41e82f464b6a0aca expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788568548.881239:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788568548.881264:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: 000000007dbf13f1/0x41e82f464b6a0ac3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0aca expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568548.881281:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788568548.881297:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: 000000007dbf13f1/0x41e82f464b6a0ac3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0aca expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568548.881303:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: 000000007dbf13f1/0x41e82f464b6a0ac3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0aca expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568548.881318:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568548.881320:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568548.881321:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568548.881339:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000db937217 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925db6b8-84bc-418c-b37a-40345c1020be:3309:1875449976196864:0@lo:103: 00000100:00100000:2.0:1788568548.881368:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568548.881412:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976196864 00000100:00100000:2.0:1788568548.881416:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976196864 00010000:00010000:2.0:1788568548.881433:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000bc3ca3d0/0x41e82f464b6a0aca lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0ac3 expref: 12 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568548.881455:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788568548.881460:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000016fc94e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:925db6b8-84bc-418c-b37a-40345c1020be+12:3309:x1875449976196864:12345-0@lo:103: 00010000:00010000:2.0:1788568548.881469:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568548.881473:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000bc3ca3d0/0x41e82f464b6a0aca lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0ac3 expref: 12 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568548.881482:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000bc3ca3d0/0x41e82f464b6a0aca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x41e82f464b6a0ac3 expref: 12 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568548.881497:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000006368d17/0x41e82f464b6a0b09 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568548.881514:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000006368d17/0x41e82f464b6a0b09 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568548.881526:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000006368d17/0x41e82f464b6a0b09 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568548.881532:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000006368d17/0x41e82f464b6a0b09 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568548.881538:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000006368d17/0x41e82f464b6a0b09 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568548.881544:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000006368d17/0x41e82f464b6a0b09 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568548.881548:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000006368d17 already unused, calling callback (0000000070f7c6a3) 00010000:00010000:2.0:1788568548.881552:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000006368d17/0x41e82f464b6a0b09 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568548.881559:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000006368d17/0x41e82f464b6a0b09 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568548.881567:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000006368d17/0x41e82f464b6a0b09 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568548.881576:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568548.881603:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000016fc94e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:925db6b8-84bc-418c-b37a-40345c1020be+12:3309:x1875449976196864:12345-0@lo:103: Request processed in 143us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568548.881610:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788568548.881641:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000db937217 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925db6b8-84bc-418c-b37a-40345c1020be:3309:1875449976196864:0@lo:103: 00010000:00010000:0.0:1788568548.882087:0:6322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bc3ca3d0/0x41e82f464b6a0aca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x41e82f464b6a0ac3 expref: 11 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568548.882099:0:6322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ba112368 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6322:1875449976196736:0@lo:104: 00010000:00010000:0.0:1788568548.882112:0:6322:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000006368d17/0x41e82f464b6a0b09 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568548.882126:0:6322:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000006368d17/0x41e82f464b6a0b09 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568548.882132:0:6322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000006368d17/0x41e82f464b6a0b09 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568548.882137:0:6322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000006368d17/0x41e82f464b6a0b09 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568549.367227:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000db937217 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976196992:0@lo:400: 00000100:00100000:3.0:1788568549.367291:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568549.367440:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976196992 00000100:00100000:2.0:1788568549.367447:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976196992 00000100:00100000:2.0:1788568549.367488:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788568549.367495:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3a36e7c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976196992:12345-0@lo:400: 00000100:00100000:2.0:1788568549.367539:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3a36e7c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976196992:12345-0@lo:400: Request processed in 45us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568549.367546:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788568549.367617:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000db937217 x1875449976196992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568549.367630:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000db937217 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976196992:0@lo:400: 00010000:00010000:3.0:1788568549.496477:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568550.545580:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568551.607307:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568552.631601:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568553.656046:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568554.487553:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ffcc5cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925db6b8-84bc-418c-b37a-40345c1020be:3307:1875449976197120:0@lo:400: 00000100:00100000:2.0:1788568554.487553:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f1aee5ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875449976197248:0@lo:400: 00000100:00100000:2.0:1788568554.494279:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568554.494574:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976197248 00000100:00100000:1.0:1788568554.494582:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976197248 00000100:00100000:1.0:1788568554.494630:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788568554.494637:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e10d69f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875449976197248:12345-0@lo:400: 00000100:00100000:1.0:1788568554.494687:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e10d69f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875449976197248:12345-0@lo:400: Request processed in 51us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568554.494694:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788568554.494728:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f1aee5ed x1875449976197248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568554.494740:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f1aee5ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875449976197248:0@lo:400: 00000100:00100000:3.0:1788568554.498110:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568554.500829:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976197120 00000100:00100000:2.0:1788568554.500853:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976197120 00000100:00100000:2.0:1788568554.500912:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788568554.500920:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e594b1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+11:3307:x1875449976197120:12345-0@lo:400: 00000100:00100000:2.0:1788568554.501018:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e594b1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+11:3307:x1875449976197120:12345-0@lo:400: Request processed in 99us (2915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568554.501025:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788568554.501130:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ffcc5cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925db6b8-84bc-418c-b37a-40345c1020be:3307:1875449976197120:0@lo:400: 00010000:00010000:3.0:1788568554.681198:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568555.703171:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788568556.023117:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788568556.023123:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae26b352000 from 1 10000000:01000000:2.0:1788568556.023127:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788568556.023167:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: 00000000451ed4e7/0x41e82f464b6a0b10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568556.023178:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: 00000000451ed4e7/0x41e82f464b6a0b10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568556.023189:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: 00000000451ed4e7/0x41e82f464b6a0b10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568556.023211:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d15ba858 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976197376:0@lo:101: 00000100:00100000:2.0:1788568556.023284:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568556.023353:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000490fcf80 going to sleep for 11 seconds 00000100:00100000:0.0:1788568556.023431:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976197376 00000100:00100000:0.0:1788568556.023439:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976197376 00000100:00100000:0.0:1788568556.023487:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788568556.023495:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae290f26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+11:5838:x1875449976197376:12345-0@lo:101: 00010000:00010000:0.0:1788568556.023508:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568556.023520:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a781436d/0x41e82f464b6a0b17 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0b10 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568556.023541:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a781436d/0x41e82f464b6a0b17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0b10 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568556.023549:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a781436d/0x41e82f464b6a0b17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0b10 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568556.023557:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a781436d, rc 0) 00000100:00100000:0.0:1788568556.023598:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae290f26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+12:5838:x1875449976197376:12345-0@lo:101: Request processed in 104us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568556.023604:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788568556.027273:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d15ba858 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976197376:0@lo:101: 00010000:00010000:1.0:1788568556.027304:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: 00000000451ed4e7/0x41e82f464b6a0b10 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0b17 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568556.027314:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: 00000000451ed4e7/0x41e82f464b6a0b10 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0b17 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568556.027408:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000030980128 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976197504:0@lo:501: 00000100:00100000:1.0:1788568556.027464:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568556.027511:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 000000000755d582 going to sleep for 11 seconds 00000100:00100000:0.0:1788568556.027785:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976197504 00000100:00100000:0.0:1788568556.027800:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976197504 00000100:00100000:0.0:1788568556.027852:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788568556.027862:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d43734b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+12:5838:x1875449976197504:12345-0@lo:501: 00000100:00100000:0.0:1788568556.028185:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d43734b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+12:5838:x1875449976197504:12345-0@lo:501: Request processed in 324us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568556.028193:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788568556.028238:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000030980128 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976197504:0@lo:501: 00000100:00100000:0.0:1788568556.028268:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ba112368 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976197632:0@lo:503: 00000100:00100000:0.0:1788568556.028305:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568556.028320:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000aed32570 going to sleep for 11 seconds 00000100:00100000:0.0:1788568556.028331:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976197632 00000100:00100000:0.0:1788568556.028334:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976197632 00000100:00100000:0.0:1788568556.028352:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788568556.028357:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc92ba14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+12:5838:x1875449976197632:12345-0@lo:503: 00000100:00100000:0.0:1788568556.028564:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc92ba14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+12:5838:x1875449976197632:12345-0@lo:503: Request processed in 207us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568556.028572:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788568556.028607:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ba112368 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976197632:0@lo:503: 00000100:00100000:0.0:1788568556.030439:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ba112368 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:6687:1875449976197760:0@lo:502: 00000100:00100000:0.0:1788568556.030510:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568556.030549:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set 0000000074785252 going to sleep for 11 seconds 00000100:00100000:1.0:1788568556.030598:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976197760 00000100:00100000:1.0:1788568556.030605:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976197760 00000100:00100000:1.0:1788568556.030653:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788568556.030661:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cc5da444 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+12:6687:x1875449976197760:12345-0@lo:502: 00000100:00100000:1.0:1788568556.030876:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cc5da444 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+12:6687:x1875449976197760:12345-0@lo:502: Request processed in 216us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568556.030884:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788568556.031157:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ba112368 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:6687:1875449976197760:0@lo:502: 00000020:01000000:0.0:1788568556.031183:0:6687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788568556.031191:0:6687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788568556.031193:0:6687:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788568556.031200:0:6687:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ae26b352000 00000020:00000080:0.0:1788568556.031209:0:6687:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788568556.031246:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf62300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:6687:1875449976197888:0@lo:502: 00000100:00100000:0.0:1788568556.031282:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568556.031308:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae250af9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788568556.031435:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976197888 00000100:00100000:2.0:1788568556.031440:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976197888 00000100:00100000:2.0:1788568556.031474:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788568556.031481:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+12:6687:x1875449976197888:12345-0@lo:502: 00000100:00100000:2.0:1788568556.031613:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+12:6687:x1875449976197888:12345-0@lo:502: Request processed in 132us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568556.031621:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788568556.031675:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf62300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:6687:1875449976197888:0@lo:502: 00000020:01000000:2.0:1788568556.031692:0:6687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788568556.031697:0:6687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788568556.031698:0:6687:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788568556.032452:0:6687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788568556.032607:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788568556.032629:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788568556.032649:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b200/0x41e82f464b6a0b10 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0b17 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568556.032660:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b200/0x41e82f464b6a0b10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0b17 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788568556.180034:0:6685:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788568556.180037:0:6685:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788568556.180191:0:6685:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ae27bf74800 00000020:01000004:2.0:1788568556.180205:0:6685:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788568556.180215:0:6685:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788568556.180237:0:6685:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9ae248ddcd40) 00000020:00000080:2.0:1788568556.180252:0:6685:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788568556.196123:0:6685:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788568556.196391:0:6685:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788568556.239770:0:6685:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788568556.250583:0:6685:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788568556.250614:0:6685:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788568556.250891:0:6685:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788568556.250923:0:6685:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788568556.251293:0:6685:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788568556.251310:0:6685:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788568556.251318:0:6685:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x41e82f464b6a0b25 00000020:01000004:2.0:1788568556.251325:0:6685:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788568556.251345:0:6685:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.104@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788568556.251348:0:6685:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788568556.251353:0:6685:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788568556.251357:0:6685:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788568556.251368:0:6685:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9ae248dd99c0) 00000020:00000080:2.0:1788568556.251379:0:6685:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1788568556.252516:0:6685:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788568556.252676:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788568556.252682:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788568556.262754:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788568556.262769:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788568556.272255:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788568556.272272:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788568556.273710:0:6685:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788568556.273875:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788568556.273880:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788568556.278370:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788568556.278382:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788568556.312651:0:6685:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788568556.312882:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788568556.312889:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788568556.320134:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788568556.320155:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788568556.321896:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788568556.321913:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788568556.329855:0:6685:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788568556.332909:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788568556.332918:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788568556.333723:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788568556.333732:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788568556.391967:0:6685:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788568556.392308:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788568556.392314:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788568556.396419:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788568556.396433:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788568556.397298:0:6685:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788568556.397322:0:6685:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1788568556.397328:0:6685:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.104@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788568556.418840:0:6685:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.104@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788568556.418878:0:6685:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.104@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788568556.418882:0:6685:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788568556.418884:0:6685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788568556.418885:0:6685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788568556.418886:0:6685:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788568556.418887:0:6685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788568556.418888:0:6685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788568556.418890:0:6685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788568556.418891:0:6685:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788568556.418892:0:6685:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788568556.418894:0:6685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788568556.418896:0:6685:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788568556.418899:0:6685:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788568556.418901:0:6685:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788568556.418906:0:6685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788568556.418907:0:6685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788568556.418908:0:6685:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788568556.418909:0:6685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788568556.418910:0:6685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788568556.418910:0:6685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788568556.418911:0:6685:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788568556.418912:0:6685:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788568556.418913:0:6685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788568556.418914:0:6685:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788568556.418961:0:6685:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788568556.418979:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:6685:1875449976198016:0@lo:253: 00000100:00100000:2.0:1788568556.419124:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568556.419239:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae26b2940c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788568556.419437:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976198016 00000100:00100000:0.0:1788568556.419444:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976198016 00000100:00100000:0.0:1788568556.419493:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788568556.419503:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+12:6685:x1875449976198016:12345-0@lo:253: 20000000:01000000:0.0:1788568556.419531:0:5834:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788568556.419535:0:5834:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788568556.419540:0:5834:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788568556.419543:0:5834:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788568556.420860:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788568556.421453:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1788568556.421473:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1788568556.421530:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1788568556.421539:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1788568556.421568:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1788568556.421615:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1788568556.422518:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1788568556.422542:0:5834:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.104@tcp 20000000:01000000:2.0:1788568556.422544:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.104@tcp (null) (null) (null) 00000040:00080000:2.0:1788568556.422578:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1788568556.422587:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788568556.422636:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1788568556.422646:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.104@tcp (null) (null) 00000040:00080000:2.0:1788568556.422678:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1788568556.422688:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788568556.422786:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1788568556.422851:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1788568556.425387:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1788568556.425418:0:5834:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.104@tcp 20000000:01000000:2.0:1788568556.425421:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.104@tcp (null) (null) (null) 00000040:00080000:2.0:1788568556.425472:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1788568556.425480:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788568556.425511:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1788568556.425518:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.104@tcp (null) (null) 00000040:00080000:2.0:1788568556.425568:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1788568556.425580:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788568556.425612:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1788568556.425648:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1788568556.425666:0:5834:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788568556.425669:0:5834:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788568556.425673:0:5834:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788568556.425688:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788568556.425690:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788568556.425740:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788568556.425743:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788568556.426579:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1788568556.426839:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1788568556.426902:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1788568556.427168:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1788568556.427252:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788568556.427255:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788568556.427669:0:6702:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1788568556.427730:0:6702:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1788568556.427782:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1788568556.428074:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1788568556.428127:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1788568556.428165:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1788568556.428301:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788568556.428303:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788568556.428796:0:6703:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1788568556.428842:0:6703:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1788568556.428921:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1788568556.429357:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1788568556.429393:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1788568556.429445:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1788568556.429461:0:5834:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1788568556.429464:0:5834:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1788568556.429474:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788568556.429494:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ae252e7aa00/0x41e82f464b6a0b33 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568556.429521:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae282045e00/0x41e82f464b6a0a4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0a45 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568556.429528:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae282045a00/0x41e82f464b6a0a68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0a61 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568556.429535:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae282044000/0x41e82f464b6a0ad8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0ad1 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568556.429543:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ae252e7aa00/0x41e82f464b6a0b33 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568556.429578:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae282044000/0x41e82f464b6a0ad8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x41e82f464b6a0ad1 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568556.429592:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ae282044000/0x41e82f464b6a0ad8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x41e82f464b6a0ad1 expref: 12 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568556.429606:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce6680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1875449976198144:0@lo:104: 00000100:00100000:2.0:1788568556.429663:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788568556.429824:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae282045a00/0x41e82f464b6a0a68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x41e82f464b6a0a61 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568556.429834:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ae282045a00/0x41e82f464b6a0a68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x41e82f464b6a0a61 expref: 12 pid: 5836 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568556.429843:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce6300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1875449976198272:0@lo:104: 00000100:00100000:2.0:1788568556.429866:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788568556.430362:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae282045e00/0x41e82f464b6a0a4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x41e82f464b6a0a45 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568556.430380:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ae282045e00/0x41e82f464b6a0a4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x41e82f464b6a0a45 expref: 12 pid: 5836 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568556.430390:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce5500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1875449976198400:0@lo:104: 00000100:00100000:2.0:1788568556.430414:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568556.430436:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976198144 00000100:00100000:1.0:1788568556.430443:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976198144 00000100:00100000:0.0:1788568556.430493:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976198272 00000100:00100000:0.0:1788568556.430497:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976198272 00000100:00100000:0.0:1788568556.430519:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788568556.430528:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cce7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:925db6b8-84bc-418c-b37a-40345c1020be+4:5834:x1875449976198144:12345-0@lo:104: 00010000:00010000:0.0:1788568556.430539:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.104@tcp lock: ffff9ae2429dfa00/0x41e82f464b6a0ad1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0ad8 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568556.430630:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788568556.430637:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cce7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:925db6b8-84bc-418c-b37a-40345c1020be+4:5834:x1875449976198144:12345-0@lo:104: Request processed in 111us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568556.430644:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788568556.430662:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788568556.430668:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cce5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:925db6b8-84bc-418c-b37a-40345c1020be+3:5834:x1875449976198272:12345-0@lo:104: 00010000:00010000:0.0:1788568556.430676:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.104@tcp lock: ffff9ae240031c00/0x41e82f464b6a0a61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0a68 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568556.430741:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae26b294b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788568556.430760:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce6680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1875449976198144:0@lo:104: 00000100:00100000:2.0:1788568556.430768:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce6300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1875449976198272:0@lo:104: 00000100:00100000:1.0:1788568556.430864:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1788568556.430872:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:2.0:1788568556.431317:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976198400 00000100:00100000:2.0:1788568556.431321:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976198400 00010000:00010000:3.0:1788568556.431399:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788568556.431408:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae2429dfa00/0x41e82f464b6a0ad1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0ad8 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.431415:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429dfa00 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:3.0:1788568556.431419:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae2429dfa00/0x41e82f464b6a0ad1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x41e82f464b6a0ad8 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.431428:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae2429dfa00/0x41e82f464b6a0ad1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x41e82f464b6a0ad8 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788568556.431435:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae2429dfa00/0x41e82f464b6a0ad1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x41e82f464b6a0ad8 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788568556.431451:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788568556.431483:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae2429dfa00/0x41e82f464b6a0ad1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0ad8 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.431490:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788568556.431507:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae2429dfa00/0x41e82f464b6a0ad1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0ad8 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.431515:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae2429dfa00/0x41e82f464b6a0ad1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0ad8 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.431527:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788568556.431530:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae240031c00/0x41e82f464b6a0a61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0a68 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.431535:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae240031c00 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:3.0:1788568556.431537:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae240031c00/0x41e82f464b6a0a61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x41e82f464b6a0a68 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.431543:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae240031c00/0x41e82f464b6a0a61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x41e82f464b6a0a68 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788568556.431549:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae240031c00/0x41e82f464b6a0a61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x41e82f464b6a0a68 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788568556.431554:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788568556.431565:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae240031c00/0x41e82f464b6a0a61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0a68 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.431571:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788568556.431591:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae240031c00/0x41e82f464b6a0a61 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0a68 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.431597:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae240031c00/0x41e82f464b6a0a61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0a68 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.431609:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568556.431611:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568556.431613:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568556.431643:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae28170a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925db6b8-84bc-418c-b37a-40345c1020be:3309:1875449976198528:0@lo:103: 00000100:00100000:3.0:1788568556.431684:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568556.431908:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae28170a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976198656:0@lo:103: 00000100:00100000:3.0:1788568556.431957:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568556.432065:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976198528 00000100:00100000:3.0:1788568556.432070:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976198528 00010000:00010000:3.0:1788568556.432090:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae282044000/0x41e82f464b6a0ad8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0ad1 expref: 13 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568556.432125:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976198656 00000100:00100000:3.0:1788568556.432128:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976198656 00010000:00010000:3.0:1788568556.432140:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae282045a00/0x41e82f464b6a0a68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0a61 expref: 14 pid: 5836 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568556.432152:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788568556.432159:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281709180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:925db6b8-84bc-418c-b37a-40345c1020be+14:3309:x1875449976198528:12345-0@lo:103: 00010000:00010000:3.0:1788568556.432169:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788568556.432277:0:5828:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788568556.432284:0:5828:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1788568556.432482:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae282044000/0x41e82f464b6a0ad8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0ad1 expref: 14 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.432497:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae282044000/0x41e82f464b6a0ad8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x41e82f464b6a0ad1 expref: 14 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.432519:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae282044000/0x41e82f464b6a0ad8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x41e82f464b6a0ad1 expref: 14 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.432532:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788568556.432577:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281709180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:925db6b8-84bc-418c-b37a-40345c1020be+13:3309:x1875449976198528:12345-0@lo:103: Request processed in 417us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568556.432585:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788568556.432602:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788568556.432608:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281709500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:925db6b8-84bc-418c-b37a-40345c1020be+12:3306:x1875449976198656:12345-0@lo:103: 00010000:00010000:3.0:1788568556.432616:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568556.432620:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae282045a00/0x41e82f464b6a0a68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0a61 expref: 12 pid: 5836 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.432628:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae282045a00/0x41e82f464b6a0a68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x41e82f464b6a0a61 expref: 12 pid: 5836 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.432637:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae282045a00/0x41e82f464b6a0a68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x41e82f464b6a0a61 expref: 12 pid: 5836 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.432646:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788568556.432672:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281709500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:925db6b8-84bc-418c-b37a-40345c1020be+11:3306:x1875449976198656:12345-0@lo:103: Request processed in 64us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568556.432678:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788568556.432857:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788568556.432865:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cce4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:925db6b8-84bc-418c-b37a-40345c1020be+4:5834:x1875449976198400:12345-0@lo:104: 00010000:00010000:1.0:1788568556.432881:0:6704:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.104@tcp lock: ffff9ae240030800/0x41e82f464b6a0a45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0a4c expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568556.432923:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788568556.432944:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cce4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:925db6b8-84bc-418c-b37a-40345c1020be+4:5834:x1875449976198400:12345-0@lo:104: Request processed in 81us (2530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568556.432951:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788568556.433086:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae28170a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976198656:0@lo:103: 00010000:00010000:3.0:1788568556.433119:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788568556.433124:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae240030800/0x41e82f464b6a0a45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0a4c expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.433142:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae240030800 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:3.0:1788568556.433147:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae240030800/0x41e82f464b6a0a45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x41e82f464b6a0a4c expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.433154:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae240030800/0x41e82f464b6a0a45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x41e82f464b6a0a4c expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788568556.433160:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae240030800/0x41e82f464b6a0a45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x41e82f464b6a0a4c expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788568556.433165:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788568556.433265:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae240030800/0x41e82f464b6a0a45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0a4c expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.433271:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788568556.433313:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae28170a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925db6b8-84bc-418c-b37a-40345c1020be:3307:1875449976198784:0@lo:103: 00000100:00100000:1.0:1788568556.433344:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568556.433434:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae28170a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925db6b8-84bc-418c-b37a-40345c1020be:3309:1875449976198528:0@lo:103: 00000100:00100000:2.0:1788568556.433458:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce5500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1875449976198400:0@lo:104: 00010000:00010000:2.0:1788568556.433479:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ae252e7aa00/0x41e82f464b6a0b33 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.433531:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae240030800/0x41e82f464b6a0a45 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0a4c expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.433539:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae240030800/0x41e82f464b6a0a45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0a4c expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.433553:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568556.433555:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568556.433557:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568556.433567:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976198784 00000100:00100000:3.0:1788568556.433572:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976198784 00010000:00010000:3.0:1788568556.433589:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae282045e00/0x41e82f464b6a0a4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0a45 expref: 11 pid: 5836 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568556.433608:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788568556.433620:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:925db6b8-84bc-418c-b37a-40345c1020be+11:3307:x1875449976198784:12345-0@lo:103: 00010000:00010000:3.0:1788568556.433628:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568556.433633:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae282045e00/0x41e82f464b6a0a4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0a45 expref: 11 pid: 5836 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.433642:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae282045e00/0x41e82f464b6a0a4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x41e82f464b6a0a45 expref: 11 pid: 5836 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.433652:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae282045e00/0x41e82f464b6a0a4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x41e82f464b6a0a45 expref: 11 pid: 5836 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.433665:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ae252e7aa00/0x41e82f464b6a0b33 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.433672:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae252e7aa00/0x41e82f464b6a0b33 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.433684:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae252e7aa00/0x41e82f464b6a0b33 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.433690:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae252e7aa00/0x41e82f464b6a0b33 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.433696:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ae252e7aa00/0x41e82f464b6a0b33 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.433702:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ae252e7aa00/0x41e82f464b6a0b33 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.433717:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7aa00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788568556.433721:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ae252e7aa00/0x41e82f464b6a0b33 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.433736:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ae252e7aa00/0x41e82f464b6a0b33 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.433747:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ae252e7aa00/0x41e82f464b6a0b33 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.433756:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788568556.433813:0:5834:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ae252e7aa00/0x41e82f464b6a0b33 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568556.433821:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ae252e7aa00/0x41e82f464b6a0b33 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568556.433828:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae252e7aa00/0x41e82f464b6a0b33 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788568556.433841:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:0.0:1788568556.436333:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1788568556.436350:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cce5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:925db6b8-84bc-418c-b37a-40345c1020be+3:5834:x1875449976198272:12345-0@lo:104: Request processed in 5677us (6478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568556.436361:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788568556.437132:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:925db6b8-84bc-418c-b37a-40345c1020be+10:3307:x1875449976198784:12345-0@lo:103: Request processed in 3508us (3783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568556.437142:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788568556.437248:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568556.445598:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae28170a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925db6b8-84bc-418c-b37a-40345c1020be:3307:1875449976198784:0@lo:103: 00000100:00100000:3.0:1788568556.468252:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+9:6685:x1875449976198016:12345-0@lo:253: Request processed in 48741us (49119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568556.468266:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788568556.468445:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:6685:1875449976198016:0@lo:253: 10000000:01000000:2.0:1788568556.468478:0:6685:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788568556.468482:0:6685:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788568556.468484:0:6685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788568556.468485:0:6685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788568556.468486:0:6685:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1788568556.468487:0:6685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788568556.468488:0:6685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788568556.468489:0:6685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788568556.468490:0:6685:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788568556.468492:0:6685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788568556.468493:0:6685:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788568556.468510:0:6685:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ae27bf74800 from lustre-OST0000 10000000:01000000:2.0:1788568556.468534:0:6685:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788568556.468537:0:6685:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788568556.468544:0:6685:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ae26b2dcd40 local copy 10000000:01000000:2.0:1788568556.468547:0:6685:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788568556.468577:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7aa00/0x41e82f464b6a0b3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568556.468587:0:6685:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.104@tcp lock: ffff9ae252e7aa00/0x41e82f464b6a0b3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568556.468597:0:6685:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae252e7aa00/0x41e82f464b6a0b3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568556.468614:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:6685:1875449976198912:0@lo:101: 00000100:00100000:2.0:1788568556.468653:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568556.468706:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae244605900 going to sleep for 11 seconds 00000100:00100000:0.0:1788568556.468798:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976198912 00000100:00100000:0.0:1788568556.468805:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976198912 00000100:00100000:0.0:1788568556.468890:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788568556.468900:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+9:6685:x1875449976198912:12345-0@lo:101: 00010000:00010000:0.0:1788568556.468914:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568556.468959:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae240030200/0x41e82f464b6a0b41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0b3a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568556.469003:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae240030200/0x41e82f464b6a0b41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0b3a expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568556.469013:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae240030200/0x41e82f464b6a0b41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0b3a expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568556.469022:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae240030200, rc 0) 00000100:00100000:0.0:1788568556.469056:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+10:6685:x1875449976198912:12345-0@lo:101: Request processed in 158us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568556.469062:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788568556.469378:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:6685:1875449976198912:0@lo:101: 00010000:00010000:3.0:1788568556.469391:0:6685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae252e7aa00/0x41e82f464b6a0b3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x41e82f464b6a0b41 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.469400:0:6685:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae252e7aa00/0x41e82f464b6a0b3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x41e82f464b6a0b41 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568556.469514:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae281708700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:6685:1875449976199040:0@lo:501: 00000100:00100000:3.0:1788568556.469546:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568556.469672:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae244519f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788568556.469707:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976199040 00000100:00100000:2.0:1788568556.469712:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976199040 00000100:00100000:2.0:1788568556.469738:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788568556.469745:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae250448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+10:6685:x1875449976199040:12345-0@lo:501: 00000100:00100000:2.0:1788568556.469972:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae250448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+10:6685:x1875449976199040:12345-0@lo:501: Request processed in 227us (424us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788568556.469991:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788568556.470374:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae281708700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:6685:1875449976199040:0@lo:501: 10000000:01000000:2.0:1788568556.470392:0:6685:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788568556.470421:0:6685:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788568556.470428:0:6685:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7aa00/0x41e82f464b6a0b3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x41e82f464b6a0b41 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568556.470437:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7aa00/0x41e82f464b6a0b3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x41e82f464b6a0b41 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568556.470444:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.104@tcp lock: ffff9ae252e7aa00/0x41e82f464b6a0b3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x41e82f464b6a0b41 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568556.470461:0:6685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788568556.470479:0:6685:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ae27bf74800 10000000:01000000:2.0:1788568556.470484:0:6685:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788568556.470488:0:6685:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9ae26b2dcd40 10000000:01000000:2.0:1788568556.470490:0:6685:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788568556.470493:0:6685:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9ae26b2dcd40 from 1 10000000:01000000:2.0:1788568556.470496:0:6685:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788568556.470516:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b400/0x41e82f464b6a0b48 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568556.470524:0:6685:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b400/0x41e82f464b6a0b48 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568556.470533:0:6685:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b400/0x41e82f464b6a0b48 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568556.470554:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:6685:1875449976199168:0@lo:101: 00000100:00100000:2.0:1788568556.470582:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568556.470613:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae244605600 going to sleep for 11 seconds 00000100:00100000:1.0:1788568556.470669:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976199168 00000100:00100000:1.0:1788568556.470674:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976199168 00000100:00100000:1.0:1788568556.470696:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788568556.470702:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae250448850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+10:6685:x1875449976199168:12345-0@lo:101: 00010000:00010000:1.0:1788568556.470711:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568556.470721:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae282045c00/0x41e82f464b6a0b4f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0b48 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568556.470738:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae282045c00/0x41e82f464b6a0b4f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0b48 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568556.470747:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae282045c00/0x41e82f464b6a0b4f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0b48 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568556.470755:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae282045c00, rc 0) 00000100:00100000:1.0:1788568556.470793:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae250448850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+11:6685:x1875449976199168:12345-0@lo:101: Request processed in 91us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568556.470800:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788568556.470958:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:6685:1875449976199168:0@lo:101: 00010000:00010000:2.0:1788568556.470970:0:6685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b400/0x41e82f464b6a0b48 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0b4f expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568556.471048:0:6685:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b400/0x41e82f464b6a0b48 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0b4f expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788568556.471070:0:6685:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788568556.471081:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b400/0x41e82f464b6a0b48 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0b4f expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568556.471088:0:6685:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b400/0x41e82f464b6a0b48 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0b4f expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788568556.471095:0:6685:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788568556.471099:0:6685:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788568556.471114:0:6685:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788568556.471116:0:6685:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788568556.471131:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b600/0x41e82f464b6a0b56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568556.471137:0:6685:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b600/0x41e82f464b6a0b56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568556.471145:0:6685:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b600/0x41e82f464b6a0b56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568556.471164:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:6685:1875449976199296:0@lo:101: 00000100:00100000:2.0:1788568556.471269:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568556.471292:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae244605600 going to sleep for 11 seconds 00000100:00100000:1.0:1788568556.471355:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976199296 00000100:00100000:1.0:1788568556.471360:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976199296 00000100:00100000:1.0:1788568556.471380:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788568556.471387:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae250449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+11:6685:x1875449976199296:12345-0@lo:101: 00010000:00010000:1.0:1788568556.471395:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568556.471403:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae282044e00/0x41e82f464b6a0b5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0b56 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568556.471417:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae282044e00/0x41e82f464b6a0b5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0b56 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568556.471425:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae282044e00/0x41e82f464b6a0b5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0b56 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568556.471432:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae282044e00, rc 0) 00000100:00100000:1.0:1788568556.471465:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae250449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+12:6685:x1875449976199296:12345-0@lo:101: Request processed in 78us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568556.471471:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788568556.471546:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:6685:1875449976199296:0@lo:101: 00010000:00010000:2.0:1788568556.471559:0:6685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b600/0x41e82f464b6a0b56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0b5d expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568556.471565:0:6685:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b600/0x41e82f464b6a0b56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0b5d expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568556.471646:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:6685:1875449976199424:0@lo:501: 00000100:00100000:2.0:1788568556.471669:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568556.471697:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae244605600 going to sleep for 11 seconds 00000100:00100000:0.0:1788568556.471753:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976199424 00000100:00100000:0.0:1788568556.471757:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976199424 00000100:00100000:0.0:1788568556.471779:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788568556.471785:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+12:6685:x1875449976199424:12345-0@lo:501: 00010000:00010000:2.0:1788568556.472344:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788568556.472352:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae252e7aa00/0x41e82f464b6a0b3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x41e82f464b6a0b41 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568556.472360:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7aa00 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:2.0:1788568556.472364:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae252e7aa00/0x41e82f464b6a0b3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x41e82f464b6a0b41 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568556.472372:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae252e7aa00/0x41e82f464b6a0b3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x41e82f464b6a0b41 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788568556.472379:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae252e7aa00/0x41e82f464b6a0b3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x41e82f464b6a0b41 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788568556.472385:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788568556.472413:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae252e7aa00/0x41e82f464b6a0b3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x41e82f464b6a0b41 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568556.472419:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788568556.472446:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae252e7aa00/0x41e82f464b6a0b3a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x41e82f464b6a0b41 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568556.472453:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae252e7aa00/0x41e82f464b6a0b3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x41e82f464b6a0b41 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568556.472464:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568556.472466:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568556.472468:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568556.472474:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788568556.472485:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925db6b8-84bc-418c-b37a-40345c1020be:3309:1875449976199552:0@lo:103: 00000100:00100000:2.0:1788568556.472519:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568556.472619:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+12:6685:x1875449976199424:12345-0@lo:501: Request processed in 833us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568556.472628:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788568556.472761:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976199552 00000100:00100000:3.0:1788568556.472768:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976199552 00000100:00100000:3.0:1788568556.472810:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788568556.472818:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cce6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:925db6b8-84bc-418c-b37a-40345c1020be+12:3309:x1875449976199552:12345-0@lo:103: 00010000:00010000:3.0:1788568556.472912:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568556.473115:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae240030200/0x41e82f464b6a0b41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x41e82f464b6a0b3a expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.473131:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788568556.473171:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cce6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:925db6b8-84bc-418c-b37a-40345c1020be+11:3309:x1875449976199552:12345-0@lo:103: Request processed in 354us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568556.473353:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:6685:1875449976199424:0@lo:501: 00000100:00100000:2.0:1788568556.473394:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:6685:1875449976199680:0@lo:503: 00000100:00100000:2.0:1788568556.473439:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568556.473464:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae244605600 going to sleep for 11 seconds 00000100:00100000:3.0:1788568556.473501:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788568556.473567:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925db6b8-84bc-418c-b37a-40345c1020be:3309:1875449976199552:0@lo:103: 00000100:00100000:1.0:1788568556.473617:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976199680 00000100:00100000:1.0:1788568556.473622:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976199680 00000100:00100000:1.0:1788568556.473689:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788568556.473698:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+11:6685:x1875449976199680:12345-0@lo:503: 00000100:00100000:1.0:1788568556.474159:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+11:6685:x1875449976199680:12345-0@lo:503: Request processed in 461us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568556.474166:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788568556.474334:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:6685:1875449976199680:0@lo:503: 00000040:00080000:2.0:1788568556.474595:0:6685:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788568556.474672:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:6685:1875449976199808:0@lo:502: 00000100:00100000:2.0:1788568556.474717:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568556.474794:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae244605600 going to sleep for 11 seconds 00000100:00100000:1.0:1788568556.474841:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976199808 00000100:00100000:1.0:1788568556.474847:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976199808 00000100:00100000:1.0:1788568556.474886:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788568556.474894:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae250449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+11:6685:x1875449976199808:12345-0@lo:502: 00000100:00100000:1.0:1788568556.475407:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae250449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+11:6685:x1875449976199808:12345-0@lo:502: Request processed in 513us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568556.475416:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788568556.475503:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:6685:1875449976199808:0@lo:502: 00000040:00080000:2.0:1788568556.475746:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788568556.475791:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788568556.475852:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788568556.475915:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788568556.476118:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788568556.476158:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788568556.476269:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:6685:1875449976199936:0@lo:502: 00000100:00100000:2.0:1788568556.476313:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568556.476351:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae244605600 going to sleep for 11 seconds 00000100:00100000:0.0:1788568556.476412:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976199936 00000100:00100000:0.0:1788568556.476418:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976199936 00000100:00100000:0.0:1788568556.476457:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788568556.476466:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+11:6685:x1875449976199936:12345-0@lo:502: 00000100:00100000:0.0:1788568556.476623:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+11:6685:x1875449976199936:12345-0@lo:502: Request processed in 157us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568556.476630:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788568556.476837:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:6685:1875449976199936:0@lo:502: 00000040:00080000:2.0:1788568556.476969:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788568556.477127:0:6685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1788568556.477682:0:6707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788568556.477694:0:6707:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788568556.477701:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788568556.477703:0:6707:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788568556.477708:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788568556.477728:0:6707:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9ae27bbc19c0) 00000020:00000080:0.0:1788568556.477749:0:6707:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788568556.477757:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788568556.477857:0:6707:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ae27bf74800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788568556.477864:0:6707:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788568556.477871:0:6707:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x41e82f464b6a0b6b 00010000:00010000:2.0:1788568556.483664:0:6707:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1788568556.484435:0:6707:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1788568556.487533:0:6707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788568556.487809:0:6707:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1788568556.502246:0:6707:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788568556.506086:0:6707:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1788568556.511953:0:6707:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788568556.511967:0:6707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788568556.511974:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788568556.511977:0:6707:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788568556.511980:0:6707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788568556.512257:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788568556.512259:0:6707:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788568556.512264:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788568556.512266:0:6707:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788568556.512329:0:6707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788568556.512332:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788568556.512334:0:6707:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788568556.512338:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788568556.518578:0:6685:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1788568556.518630:0:6685:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788568556.518652:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b600/0x41e82f464b6a0b56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0b5d expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.518666:0:6685:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b600/0x41e82f464b6a0b56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0b5d expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568556.518748:0:6685:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae27bf74800 from 1 10000000:01000000:0.0:1788568556.518752:0:6685:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788568556.518791:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae240030000/0x41e82f464b6a0b72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568556.518800:0:6685:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae240030000/0x41e82f464b6a0b72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568556.518809:0:6685:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae240030000/0x41e82f464b6a0b72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568556.518906:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf61500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:6685:1875449976200064:0@lo:101: 00000100:00100000:0.0:1788568556.519069:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568556.519127:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976200064 00000100:00100000:0.0:1788568556.519135:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976200064 00000100:00100000:0.0:1788568556.519255:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788568556.519266:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae250448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+11:6685:x1875449976200064:12345-0@lo:101: 00010000:00010000:0.0:1788568556.519279:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568556.519292:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae240031e00/0x41e82f464b6a0b79 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0b72 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568556.519335:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae240031e00/0x41e82f464b6a0b79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0b72 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568556.519346:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae240031e00/0x41e82f464b6a0b79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0b72 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568556.519356:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae240031e00, rc 0) 00000100:00100000:0.0:1788568556.519386:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae250448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+12:6685:x1875449976200064:12345-0@lo:101: Request processed in 123us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568556.519393:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788568556.520197:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae250af9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788568556.520229:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf61500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:6685:1875449976200064:0@lo:101: 00010000:00010000:0.0:1788568556.520250:0:6685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae240030000/0x41e82f464b6a0b72 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0b79 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568556.520261:0:6685:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae240030000/0x41e82f464b6a0b72 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0b79 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568556.520363:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf61500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:6685:1875449976200192:0@lo:501: 00000100:00100000:0.0:1788568556.520403:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568556.520616:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976200192 00000100:00100000:3.0:1788568556.520622:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976200192 00000100:00100000:3.0:1788568556.520667:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788568556.520677:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+12:6685:x1875449976200192:12345-0@lo:501: 00000100:00100000:3.0:1788568556.521135:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+12:6685:x1875449976200192:12345-0@lo:501: Request processed in 459us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568556.521144:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788568556.521397:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae26b294d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788568556.521417:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf61500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:6685:1875449976200192:0@lo:501: 00000100:00100000:0.0:1788568556.521453:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf61500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:6685:1875449976200320:0@lo:503: 00000100:00100000:0.0:1788568556.521494:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568556.521552:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976200320 00000100:00100000:1.0:1788568556.521557:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976200320 00000100:00100000:1.0:1788568556.521581:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788568556.521588:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae250448050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+12:6685:x1875449976200320:12345-0@lo:503: 00000100:00100000:1.0:1788568556.521732:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae250448050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+12:6685:x1875449976200320:12345-0@lo:503: Request processed in 144us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568556.521739:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788568556.521824:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae26b294d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788568556.521909:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf61500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:6685:1875449976200320:0@lo:503: 00000040:00080000:0.0:1788568556.524439:0:6685:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788568556.524540:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf61500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:6685:1875449976200448:0@lo:502: 00000100:00100000:0.0:1788568556.524614:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568556.526251:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae26b294d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788568556.530521:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976200448 00000100:00100000:1.0:1788568556.530533:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976200448 00000100:00100000:1.0:1788568556.530630:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788568556.530641:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+12:6685:x1875449976200448:12345-0@lo:502: 00000100:00100000:1.0:1788568556.531223:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+12:6685:x1875449976200448:12345-0@lo:502: Request processed in 582us (6607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568556.531232:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788568556.531319:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf61500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:6685:1875449976200448:0@lo:502: 00000040:00080000:2.0:1788568556.531641:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788568556.531699:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788568556.531735:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:6685:1875449976200576:0@lo:502: 00000100:00100000:2.0:1788568556.531784:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568556.532191:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2446059c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788568556.532317:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976200576 00000100:00100000:0.0:1788568556.532324:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976200576 00000100:00100000:0.0:1788568556.532355:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788568556.532363:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+12:6685:x1875449976200576:12345-0@lo:502: 00000100:00100000:0.0:1788568556.532536:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+12:6685:x1875449976200576:12345-0@lo:502: Request processed in 172us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568556.532544:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788568556.532618:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:6685:1875449976200576:0@lo:502: 00000040:00080000:2.0:1788568556.532707:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788568556.532719:0:6685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788568556.533677:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788568556.533688:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788568556.533691:0:6711:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788568556.533697:0:6711:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ae27bf74800 00000020:00000080:2.0:1788568556.533699:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788568556.533717:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788568556.533721:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788568556.533722:0:6711:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788568556.533725:0:6711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788568556.533916:0:6685:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788568556.533962:0:6685:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788568556.533979:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae240030000/0x41e82f464b6a0b72 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0b79 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568556.534100:0:6685:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae240030000/0x41e82f464b6a0b72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0b79 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568556.534160:0:6685:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788568556.534163:0:6685:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ae27bf74800 10000000:01000000:0.0:1788568556.534166:0:6685:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ae27bf74800 10000000:01000000:0.0:1788568556.534170:0:6685:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788568556.534250:0:6685:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ae27bf74800 from 1 10000000:01000000:0.0:1788568556.534253:0:6685:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788568556.534284:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae240031a00/0x41e82f464b6a0b80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568556.534292:0:6685:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae240031a00/0x41e82f464b6a0b80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568556.534314:0:6685:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae240031a00/0x41e82f464b6a0b80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568556.534333:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf60700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:6685:1875449976200704:0@lo:101: 00000100:00100000:0.0:1788568556.534384:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568556.534420:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae250af99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788568556.534496:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976200704 00000100:00100000:1.0:1788568556.534504:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976200704 00000100:00100000:1.0:1788568556.534545:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788568556.534556:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+12:6685:x1875449976200704:12345-0@lo:101: 00010000:00010000:1.0:1788568556.534569:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568556.534583:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae282044800/0x41e82f464b6a0b87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0b80 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568556.534605:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae282044800/0x41e82f464b6a0b87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0b80 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568556.534629:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae282044800/0x41e82f464b6a0b87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0b80 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568556.534638:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae282044800, rc 0) 00000100:00100000:1.0:1788568556.534675:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+13:6685:x1875449976200704:12345-0@lo:101: Request processed in 121us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568556.534681:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788568556.534797:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf60700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:6685:1875449976200704:0@lo:101: 00010000:00010000:0.0:1788568556.534811:0:6685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae240031a00/0x41e82f464b6a0b80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0b87 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568556.534820:0:6685:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae240031a00/0x41e82f464b6a0b80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0b87 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568556.535137:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf60700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:6685:1875449976200832:0@lo:501: 00000100:00100000:0.0:1788568556.535165:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568556.535328:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae250af99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788568556.535395:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976200832 00000100:00100000:3.0:1788568556.535400:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976200832 00000100:00100000:1.0:1788568556.535443:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788568556.535451:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+13:6685:x1875449976200832:12345-0@lo:501: 00000100:00100000:1.0:1788568556.535688:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+13:6685:x1875449976200832:12345-0@lo:501: Request processed in 237us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568556.535695:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788568556.535767:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf60700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:6685:1875449976200832:0@lo:501: 00000100:00100000:2.0:1788568556.535798:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:6685:1875449976200960:0@lo:503: 00000100:00100000:2.0:1788568556.535851:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568556.535875:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae244605900 going to sleep for 11 seconds 00000100:00100000:1.0:1788568556.536010:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976200960 00000100:00100000:1.0:1788568556.536015:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976200960 00000100:00100000:1.0:1788568556.536036:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788568556.536041:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+13:6685:x1875449976200960:12345-0@lo:503: 00000100:00100000:1.0:1788568556.536205:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+13:6685:x1875449976200960:12345-0@lo:503: Request processed in 163us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568556.536212:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788568556.536465:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:6685:1875449976200960:0@lo:503: 00000040:00080000:2.0:1788568556.536756:0:6685:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788568556.536819:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:6685:1875449976201088:0@lo:502: 00000100:00100000:2.0:1788568556.537128:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568556.537211:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae244605900 going to sleep for 11 seconds 00000100:00100000:0.0:1788568556.537305:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976201088 00000100:00100000:0.0:1788568556.537310:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976201088 00000100:00100000:0.0:1788568556.537386:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788568556.537394:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+13:6685:x1875449976201088:12345-0@lo:502: 00000100:00100000:0.0:1788568556.537575:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+13:6685:x1875449976201088:12345-0@lo:502: Request processed in 182us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568556.537582:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788568556.537650:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:6685:1875449976201088:0@lo:502: 00000040:00080000:2.0:1788568556.537919:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788568556.538026:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788568556.538060:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788568556.538270:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788568556.538312:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788568556.538360:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788568556.538398:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788568556.538433:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788568556.538480:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788568556.538516:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788568556.538550:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788568556.538595:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788568556.538628:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788568556.538661:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788568556.538705:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788568556.538756:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788568556.538788:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788568556.538849:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788568556.538887:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788568556.538921:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788568556.539001:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788568556.539037:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788568556.539068:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788568556.539125:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788568556.539162:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788568556.539431:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788568556.539486:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788568556.539522:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1788568556.539562:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:6685:1875449976201216:0@lo:502: 00000100:00100000:2.0:1788568556.539632:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568556.540134:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae244605900 going to sleep for 11 seconds 00000100:00100000:3.0:1788568556.540417:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976201216 00000100:00100000:3.0:1788568556.540425:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976201216 00000100:00100000:3.0:1788568556.540464:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788568556.540473:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+13:6685:x1875449976201216:12345-0@lo:502: 00000100:00100000:3.0:1788568556.540711:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+13:6685:x1875449976201216:12345-0@lo:502: Request processed in 239us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568556.540719:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788568556.540862:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:6685:1875449976201216:0@lo:502: 00000040:00080000:2.0:1788568556.541249:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788568556.541263:0:6685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1788568556.541780:0:6712:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788568556.541795:0:6712:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9ae281c04d40) 00000020:00000080:3.0:1788568556.541814:0:6712:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1788568556.541887:0:6712:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ae27bf74800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788568556.541892:0:6712:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ae27bf74800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788568556.541894:0:6712:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae27bf74800 3 00010000:00080000:3.0:1788568556.541968:0:6712:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae27fd8c800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.104@tcp at head 00010000:00010000:2.0:1788568556.546370:0:6712:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1788568556.546657:0:6712:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788568556.546706:0:6712:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788568556.546720:0:6712:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x41e82f464b6a0b95 00000100:00080000:2.0:1788568556.546731:0:6712:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788568556.546737:0:6712:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ae27fd8c800 using connection 192.168.206.104@tcp/0@lo 00000100:00100000:2.0:1788568556.546773:0:6712:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae27cce5500 x1875449976201344/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788568556.546852:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1875449976201344:0@lo:38: 00000100:00100000:3.0:1788568556.546957:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568556.547397:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976201344 00000100:00100000:0.0:1788568556.547407:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976201344 00000100:00100000:0.0:1788568556.547444:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788568556.547451:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae28170bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1875449976201344:12345-0@lo:38: 00010000:00080000:0.0:1788568556.547486:0:5842:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:0.0:1788568556.547521:0:5842:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x41e82f464b6a0b9c 00000004:00100000:0.0:1788568556.547535:0:5842:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788568556.547568:0:5842:0:(import.c:65:import_set_state_nolock()) ffff9ae277911000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1788568556.547655:0:6712:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788568556.547717:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788568556.547730:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875449976201472:0@lo:400: 00000100:00100000:2.0:1788568556.547758:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568556.547791:0:5843:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788568556.547799:0:5843:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788568556.549023:0:5844:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788568556.549035:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976201472 00000100:00100000:2.0:1788568556.549042:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976201472 00000100:00100000:2.0:1788568556.549069:0:5844:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788568556.549079:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788568556.549087:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cce5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875449976201472:12345-0@lo:400: 00000100:00100000:2.0:1788568556.549165:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cce5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875449976201472:12345-0@lo:400: Request processed in 79us (1406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568556.549311:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788568556.549358:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ae27cce7b80 x1875449976201472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568572 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568556.549385:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875449976201472:0@lo:400: 00000100:00100000:0.0:1788568556.553855:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae28170bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875449976201344:12345-0@lo:38: Request processed in 6395us (6890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568556.553871:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:0.0:1788568556.555365:0:6712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1788568556.555471:0:6685:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1788568556.555496:0:6685:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788568556.555517:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae240031a00/0x41e82f464b6a0b80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0b87 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568556.555528:0:6685:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae240031a00/0x41e82f464b6a0b80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0b87 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788568556.555572:0:6685:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788568556.555574:0:6685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788568556.555576:0:6685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788568556.555577:0:6685:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788568556.555578:0:6685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788568556.555579:0:6685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788568556.555580:0:6685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788568556.555582:0:6685:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788568556.555583:0:6685:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788568556.555584:0:6685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788568556.555586:0:6685:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788568556.555589:0:6685:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1788568556.555591:0:6685:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788568556.555593:0:6685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788568556.555594:0:6685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788568556.555595:0:6685:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788568556.555600:0:6685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788568556.555601:0:6685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788568556.555602:0:6685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788568556.555602:0:6685:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788568556.555603:0:6685:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788568556.555604:0:6685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788568556.555605:0:6685:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788568556.555627:0:6685:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788568556.555643:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf63b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:6685:1875449976201600:0@lo:253: 00000100:00100000:0.0:1788568556.555702:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568556.555753:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae250af99c0 going to sleep for 11 seconds 00010000:00080000:3.0:1788568556.556067:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ae27cce5500 x1875449976201344/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788568566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568556.556078:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788568556.556086:0:3305:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788568556.556093:0:3305:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788568556.556098:0:3305:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788568556.556113:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ae27fd8c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788568556.556121:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1875449976201344:0@lo:38: 00000100:00100000:3.0:1788568556.556149:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976201600 00000100:00100000:3.0:1788568556.556154:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976201600 00000100:00100000:3.0:1788568556.556191:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788568556.556199:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+13:6685:x1875449976201600:12345-0@lo:253: 20000000:01000000:3.0:1788568556.556221:0:5834:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788568556.556233:0:5834:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788568556.591498:0:5834:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788568556.591518:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788568556.591568:0:5858:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788568556.591572:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788568556.591594:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ae252e7aa00/0x41e82f464b6a0ba3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568556.591611:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae252e7ba00/0x41e82f464b6a0b02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0afb expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568556.591620:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ae252e7aa00/0x41e82f464b6a0ba3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568556.591660:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae252e7ba00/0x41e82f464b6a0b02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x41e82f464b6a0afb expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568556.591674:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ae252e7ba00/0x41e82f464b6a0b02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x41e82f464b6a0afb expref: 13 pid: 5835 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568556.591687:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1875449976201728:0@lo:104: 00000100:00100000:2.0:1788568556.591745:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568556.591802:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27906c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788568556.592086:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976201728 00000100:00100000:3.0:1788568556.592093:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976201728 00000100:00100000:3.0:1788568556.592145:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788568556.592154:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:925db6b8-84bc-418c-b37a-40345c1020be+3:5858:x1875449976201728:12345-0@lo:104: 00010000:00010000:3.0:1788568556.592167:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.104@tcp lock: ffff9ae282045000/0x41e82f464b6a0afb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0b02 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.592234:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788568556.592240:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:925db6b8-84bc-418c-b37a-40345c1020be+3:5858:x1875449976201728:12345-0@lo:104: Request processed in 87us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568556.592247:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788568556.592266:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788568556.592271:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae282045000/0x41e82f464b6a0afb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0b02 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.592278:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae282045000 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:3.0:1788568556.592282:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae282045000/0x41e82f464b6a0afb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x41e82f464b6a0b02 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.592289:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae282045000/0x41e82f464b6a0afb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x41e82f464b6a0b02 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788568556.592297:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae282045000/0x41e82f464b6a0afb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x41e82f464b6a0b02 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788568556.592303:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788568556.592331:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae282045000/0x41e82f464b6a0afb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0b02 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.592353:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788568556.592371:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae282045000/0x41e82f464b6a0afb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0b02 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.592377:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae282045000/0x41e82f464b6a0afb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0b02 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.592391:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568556.592393:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568556.592394:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568556.592567:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1875449976201728:0@lo:104: 00010000:00010000:2.0:1788568556.592585:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ae252e7aa00/0x41e82f464b6a0ba3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568556.592612:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae281709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976201856:0@lo:103: 00000100:00100000:2.0:1788568556.592644:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568556.593801:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976201856 00000100:00100000:3.0:1788568556.593812:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976201856 00010000:00010000:3.0:1788568556.593857:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae252e7ba00/0x41e82f464b6a0b02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0afb expref: 14 pid: 5835 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568556.593886:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788568556.593895:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24461a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:925db6b8-84bc-418c-b37a-40345c1020be+14:3306:x1875449976201856:12345-0@lo:103: 00010000:00010000:3.0:1788568556.593907:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568556.593911:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9ae252e7ba00/0x41e82f464b6a0b02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0afb expref: 14 pid: 5835 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.593938:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae252e7ba00/0x41e82f464b6a0b02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x41e82f464b6a0afb expref: 14 pid: 5835 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.593954:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae252e7ba00/0x41e82f464b6a0b02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x41e82f464b6a0afb expref: 14 pid: 5835 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.593968:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ae252e7aa00/0x41e82f464b6a0ba3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.594267:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae252e7aa00/0x41e82f464b6a0ba3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788568556.594282:0:5828:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003713446s 00010000:00010000:3.0:1788568556.594287:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae252e7aa00/0x41e82f464b6a0ba3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.594295:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae252e7aa00/0x41e82f464b6a0ba3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.594303:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ae252e7aa00/0x41e82f464b6a0ba3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.594311:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ae252e7aa00/0x41e82f464b6a0ba3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.594317:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7aa00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788568556.594321:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ae252e7aa00/0x41e82f464b6a0ba3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.594329:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ae252e7aa00/0x41e82f464b6a0ba3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.594344:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ae252e7aa00/0x41e82f464b6a0ba3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568556.594355:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788568556.594412:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24461a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:925db6b8-84bc-418c-b37a-40345c1020be+13:3306:x1875449976201856:12345-0@lo:103: Request processed in 517us (1766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568556.594419:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788568556.594821:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae281709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976201856:0@lo:103: 00010000:00010000:2.0:1788568556.594918:0:5858:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ae252e7aa00/0x41e82f464b6a0ba3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568556.595259:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ae252e7aa00/0x41e82f464b6a0ba3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568556.595267:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae252e7aa00/0x41e82f464b6a0ba3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568556.602626:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+12:6685:x1875449976201600:12345-0@lo:253: Request processed in 46419us (46915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568556.602640:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788568556.602749:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf63b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:6685:1875449976201600:0@lo:253: 10000000:01000000:2.0:1788568556.602764:0:6685:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788568556.602767:0:6685:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788568556.602768:0:6685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788568556.602770:0:6685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788568556.602771:0:6685:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788568556.602772:0:6685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788568556.602773:0:6685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788568556.602775:0:6685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788568556.602776:0:6685:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788568556.602777:0:6685:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788568556.602779:0:6685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788568556.602781:0:6685:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788568556.602795:0:6685:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788568556.607050:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788568556.607341:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788568556.607548:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788568556.607702:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788568556.608097:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788568556.608426:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788568556.611597:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1788568556.735146:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788568556.857064:0:6685:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788568556.857070:0:6685:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788568556.857095:0:6685:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788568556.857158:0:6685:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.104@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788568556.857170:0:6685:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788568556.857195:0:6685:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1788568557.753681:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568558.778837:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568559.801948:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568560.825158:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568561.656226:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae251dc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925db6b8-84bc-418c-b37a-40345c1020be:3307:1875449976201984:0@lo:400: 00000100:00100000:1.0:1788568561.656287:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568561.656350:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae251dc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875449976202112:0@lo:400: 00000100:00100000:1.0:1788568561.656377:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568561.656397:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788568561.656402:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae251dc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976202240:0@lo:400: 00000100:00100000:1.0:1788568561.656426:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568561.656461:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976201984 00000100:00100000:1.0:1788568561.656468:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976201984 00000100:00100000:1.0:1788568561.656506:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788568561.656514:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+12:3307:x1875449976201984:12345-0@lo:400: 00000100:00100000:1.0:1788568561.656558:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+12:3307:x1875449976201984:12345-0@lo:400: Request processed in 45us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568561.656565:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788568561.656604:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976202112 00000100:00100000:1.0:1788568561.656608:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976202112 00000100:00100000:1.0:1788568561.656629:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976202240 00000100:00100000:1.0:1788568561.656632:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976202240 00000100:00100000:1.0:1788568561.656655:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788568561.656660:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875449976202112:12345-0@lo:400: 00000100:00100000:1.0:1788568561.656691:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875449976202112:12345-0@lo:400: Request processed in 31us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568561.656698:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788568561.656708:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788568561.656713:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976202240:12345-0@lo:400: 00000100:00100000:1.0:1788568561.656735:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976202240:12345-0@lo:400: Request processed in 22us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568561.656740:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788568561.656774:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae251dc4000 x1875449976202240/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788568561.656790:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788568561.656792:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae251dc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976202240:0@lo:400: 00010000:00080000:1.0:1788568561.656806:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae251dc7800 x1875449976202112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568561.656814:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae251dc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875449976202112:0@lo:400: 00000100:00100000:1.0:1788568561.656838:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae251dc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925db6b8-84bc-418c-b37a-40345c1020be:3307:1875449976201984:0@lo:400: 00010000:00010000:2.0:1788568561.850213:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568562.872194:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788568563.386479:0:7056:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg604-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788568563.895280:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788568564.728202:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788568564.728208:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ae26b352000 from 21 10000000:01000000:3.0:1788568564.728213:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788568564.728251:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae2429dfa00/0x41e82f464b6a0baa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568564.728263:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae2429dfa00/0x41e82f464b6a0baa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568564.728275:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae2429dfa00/0x41e82f464b6a0baa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568564.728299:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae281709f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976202368:0@lo:101: 00000100:00100000:3.0:1788568564.728363:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568564.728412:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae142aba9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788568564.728472:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976202368 00000100:00100000:2.0:1788568564.728479:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976202368 00000100:00100000:2.0:1788568564.728540:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788568564.728551:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+12:5838:x1875449976202368:12345-0@lo:101: 00010000:00010000:2.0:1788568564.728563:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568564.728576:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae252e7b000/0x41e82f464b6a0bb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0baa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568564.728600:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae252e7b000/0x41e82f464b6a0bb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0baa expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568564.728612:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae252e7b000/0x41e82f464b6a0bb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0baa expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568564.728622:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7b000, rc 0) 00000100:00100000:2.0:1788568564.728672:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+13:5838:x1875449976202368:12345-0@lo:101: Request processed in 122us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568564.728679:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788568564.728823:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae281709f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976202368:0@lo:101: 00010000:00010000:3.0:1788568564.728838:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae2429dfa00/0x41e82f464b6a0baa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0bb1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568564.728848:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae2429dfa00/0x41e82f464b6a0baa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0bb1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568564.728900:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae281709f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976202496:0@lo:501: 00000100:00100000:3.0:1788568564.728957:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568564.728976:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae142aba9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788568564.729166:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976202496 00000100:00100000:2.0:1788568564.729170:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976202496 00000100:00100000:2.0:1788568564.729202:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788568564.729210:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+13:5838:x1875449976202496:12345-0@lo:501: 00000100:00100000:2.0:1788568564.729522:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+13:5838:x1875449976202496:12345-0@lo:501: Request processed in 313us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568564.729859:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788568564.730759:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae281709f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976202496:0@lo:501: 00000100:00100000:2.0:1788568564.732070:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976202624:0@lo:503: 00000100:00100000:2.0:1788568564.732152:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568564.732195:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae25265b300 going to sleep for 11 seconds 00000100:00100000:3.0:1788568564.733366:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976202624 00000100:00100000:3.0:1788568564.733378:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976202624 00000100:00100000:3.0:1788568564.733435:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788568564.733445:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+13:5838:x1875449976202624:12345-0@lo:503: 00000100:00100000:3.0:1788568564.733818:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+13:5838:x1875449976202624:12345-0@lo:503: Request processed in 374us (1666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568564.733826:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788568564.733968:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976202624:0@lo:503: 00000100:00100000:3.0:1788568564.735072:0:7129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae281709180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:7129:1875449976202752:0@lo:502: 00000100:00100000:3.0:1788568564.735129:0:7129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568564.735972:0:7129:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae142aba900 going to sleep for 11 seconds 00000100:00100000:2.0:1788568564.738372:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976202752 00000100:00100000:2.0:1788568564.738385:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976202752 00000100:00100000:2.0:1788568564.738551:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788568564.738561:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+13:7129:x1875449976202752:12345-0@lo:502: 00000100:00100000:2.0:1788568564.738914:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+13:7129:x1875449976202752:12345-0@lo:502: Request processed in 353us (3784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568564.738950:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788568564.739165:0:7129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae281709180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:7129:1875449976202752:0@lo:502: 00000100:00100000:1.0:1788568564.739228:0:7129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae251dc6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:7129:1875449976202880:0@lo:502: 00000100:00100000:1.0:1788568564.739266:0:7129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568564.739295:0:7129:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae247c5cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788568564.739655:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976202880 00000100:00100000:2.0:1788568564.739661:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976202880 00000100:00100000:2.0:1788568564.739691:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788568564.739698:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+13:7129:x1875449976202880:12345-0@lo:502: 00000100:00100000:2.0:1788568564.740048:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+13:7129:x1875449976202880:12345-0@lo:502: Request processed in 348us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568564.740056:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788568564.744056:0:7129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae251dc6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:7129:1875449976202880:0@lo:502: 00000040:00080000:1.0:1788568564.744109:0:7129:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1788568564.744258:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1788568564.744278:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788568564.744289:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae2429dfa00/0x41e82f464b6a0baa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0bb1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568564.744299:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae2429dfa00/0x41e82f464b6a0baa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0bb1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568564.744308:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788568564.744311:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ae26b352000 from 4 10000000:01000000:0.0:1788568564.744314:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788568564.744348:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae240030200/0x41e82f464b6a0bb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568564.744356:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae240030200/0x41e82f464b6a0bb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568564.744365:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae240030200/0x41e82f464b6a0bb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568564.744393:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf61880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976203008:0@lo:101: 00000100:00100000:0.0:1788568564.744449:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568564.744498:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976203008 00000100:00100000:0.0:1788568564.744498:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae26f6a3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788568564.744507:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976203008 00000100:00100000:2.0:1788568564.744565:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788568564.744576:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+13:5838:x1875449976203008:12345-0@lo:101: 00010000:00010000:2.0:1788568564.744588:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568564.744602:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae252e7a800/0x41e82f464b6a0bbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0bb8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568564.744624:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae252e7a800/0x41e82f464b6a0bbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0bb8 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568564.744643:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae252e7a800/0x41e82f464b6a0bbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0bb8 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568564.744651:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7a800, rc 0) 00000100:00100000:2.0:1788568564.744703:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+14:5838:x1875449976203008:12345-0@lo:101: Request processed in 131us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568564.744709:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788568564.744782:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf61880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976203008:0@lo:101: 00010000:00010000:3.0:1788568564.744804:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae240030200/0x41e82f464b6a0bb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0bbf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568564.744813:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae240030200/0x41e82f464b6a0bb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0bbf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568564.744858:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae281709500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976203136:0@lo:256: 00000100:00100000:3.0:1788568564.744889:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568564.744911:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae142aba6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788568564.745133:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976203136 00000100:00100000:2.0:1788568564.745138:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976203136 00000100:00100000:2.0:1788568564.745170:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788568564.745178:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+14:5838:x1875449976203136:12345-0@lo:256: 20000000:01000000:2.0:1788568564.745194:0:5836:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788568564.745212:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788568564.745215:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788568564.745293:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+14:5838:x1875449976203136:12345-0@lo:256: Request processed in 116us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568564.745300:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788568564.745580:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae281709500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976203136:0@lo:256: 10000000:01000000:3.0:1788568564.745626:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788568564.745633:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae240030200/0x41e82f464b6a0bb8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0bbf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568564.745641:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae240030200/0x41e82f464b6a0bb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0bbf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788568564.745657:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788568564.745659:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1788568564.745661:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788568564.745677:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae2429df000/0x41e82f464b6a0bc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568564.745685:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae2429df000/0x41e82f464b6a0bc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568564.745692:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae2429df000/0x41e82f464b6a0bc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568564.745706:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae281709500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976203264:0@lo:101: 00000100:00100000:3.0:1788568564.745732:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568564.745762:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae142aba6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788568564.745774:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976203264 00000100:00100000:3.0:1788568564.745778:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976203264 00000100:00100000:3.0:1788568564.745807:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788568564.745813:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae266991850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+14:5838:x1875449976203264:12345-0@lo:101: 00010000:00010000:3.0:1788568564.745820:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568564.745828:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae2429de600/0x41e82f464b6a0bcd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0bc6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568564.745844:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae2429de600/0x41e82f464b6a0bcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0bc6 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568564.745853:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae2429de600/0x41e82f464b6a0bcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0bc6 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568564.745870:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429de600, rc 0) 00000100:00100000:3.0:1788568564.745901:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae266991850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+15:5838:x1875449976203264:12345-0@lo:101: Request processed in 88us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568564.745908:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788568564.745962:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae281709500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976203264:0@lo:101: 00010000:00010000:3.0:1788568564.745972:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae2429df000/0x41e82f464b6a0bc6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0bcd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568564.745979:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae2429df000/0x41e82f464b6a0bc6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0bcd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568564.746017:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae281709500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976203392:0@lo:501: 00000100:00100000:3.0:1788568564.746039:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568564.746051:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae142aba6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788568564.746073:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976203392 00000100:00100000:3.0:1788568564.746076:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976203392 00000100:00100000:3.0:1788568564.746094:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788568564.746100:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae266992450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+15:5838:x1875449976203392:12345-0@lo:501: 00000100:00100000:3.0:1788568564.746354:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae266992450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+15:5838:x1875449976203392:12345-0@lo:501: Request processed in 253us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568564.746361:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788568564.746388:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae281709500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976203392:0@lo:501: 00000100:00100000:3.0:1788568564.746414:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae281709500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976203520:0@lo:503: 00000100:00100000:3.0:1788568564.746451:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568564.746464:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae142aba6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788568564.746481:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976203520 00000100:00100000:3.0:1788568564.746484:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976203520 00000100:00100000:3.0:1788568564.746501:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788568564.746507:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae252782850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+15:5838:x1875449976203520:12345-0@lo:503: 00000100:00100000:3.0:1788568564.746780:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae252782850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+15:5838:x1875449976203520:12345-0@lo:503: Request processed in 272us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568564.746787:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788568564.746825:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae281709500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976203520:0@lo:503: 00000100:00100000:3.0:1788568564.747057:0:7130:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae281709500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:7130:1875449976203648:0@lo:502: 00000100:00100000:3.0:1788568564.747108:0:7130:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568564.747129:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976203648 00000100:00100000:3.0:1788568564.747133:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976203648 00000100:00100000:3.0:1788568564.747153:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788568564.747159:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae252783850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+15:7130:x1875449976203648:12345-0@lo:502: 00000100:00100000:3.0:1788568564.747356:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae252783850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+15:7130:x1875449976203648:12345-0@lo:502: Request processed in 197us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568564.747363:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788568564.747403:0:7130:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae142abaa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788568564.747419:0:7130:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae281709500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:7130:1875449976203648:0@lo:502: 00000020:01000000:3.0:1788568564.747445:0:7130:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788568564.747451:0:7130:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788568564.747457:0:7130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788568564.747459:0:7130:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788568564.747463:0:7130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788568564.747467:0:7130:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.104@tcp to nid 0x20000c0a8ce68 (192.168.206.104@tcp) 00000020:01000000:3.0:1788568564.747490:0:7130:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788568564.747492:0:7130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788568564.747520:0:7130:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9ae26fb78000) 00000020:00000080:3.0:1788568564.747549:0:7130:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788568564.747556:0:7130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788568564.747622:0:7130:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788568564.747627:0:7130:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788568564.747633:0:7130:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x41e82f464b6a0bdb 00010000:00080000:3.0:1788568564.747664:0:7130:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae2735ac000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.104@tcp at head 00010000:00010000:3.0:1788568564.747868:0:7130:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788568564.857696:0:7130:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788568564.857716:0:7130:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788568564.858358:0:7130:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788568564.858562:0:7130:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788568564.858609:0:7130:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788568564.858687:0:7130:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788568564.865842:0:7136:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788568564.865849:0:7136:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788568564.867724:0:7130:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788568564.867737:0:7130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788568564.867777:0:7130:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788568564.867813:0:7130:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x41e82f464b6a0be2 00000100:00080000:3.0:1788568564.867824:0:7130:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788568564.867830:0:7130:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ae2735ac000 using connection 192.168.206.104@tcp/0@lo 00000100:00100000:3.0:1788568564.867864:0:7130:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae281709500 x1875449976203776/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788568564.867893:0:7130:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1788568564.867956:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae281709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875449976203776:0@lo:8: 00000100:00100000:3.0:1788568564.867982:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae281709c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976203904:0@lo:400: 00000100:00100000:3.0:1788568564.868026:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568564.868028:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568564.868090:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788568564.868096:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae281708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875449976204032:0@lo:400: 00000100:00100000:3.0:1788568564.868116:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568564.868167:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976203904 00000100:00100000:3.0:1788568564.868178:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976203904 00000100:00100000:3.0:1788568564.868210:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976204032 00000100:00100000:3.0:1788568564.868212:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976204032 00000100:00100000:3.0:1788568564.868235:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788568564.868242:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae28170aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976203904:12345-0@lo:400: 00000100:00100000:3.0:1788568564.868283:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae28170aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976203904:12345-0@lo:400: Request processed in 42us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568564.868291:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788568564.868303:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788568564.868309:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae28170b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875449976204032:12345-0@lo:400: 00000100:00100000:3.0:1788568564.868332:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae28170b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875449976204032:12345-0@lo:400: Request processed in 23us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568564.868337:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788568564.868357:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788568564.868383:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae281708e00 x1875449976204032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568564.868394:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae281708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875449976204032:0@lo:400: 00010000:00080000:3.0:1788568564.868402:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae281709c00 x1875449976203904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568564.868409:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae281709c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976203904:0@lo:400: 00000020:01000000:3.0:1788568564.868465:0:7130:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788568564.868471:0:7130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788568564.868473:0:7130:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788568564.868476:0:7130:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788568564.868480:0:7130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788568564.868481:0:7130:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788568564.868485:0:7130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788568564.868487:0:7130:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788568564.868516:0:7130:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae281709c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:7130:1875449976204160:0@lo:502: 00000100:00100000:3.0:1788568564.868554:0:7130:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568564.868574:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976204160 00000100:00100000:3.0:1788568564.868576:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976204160 00000100:00100000:3.0:1788568564.868596:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788568564.868602:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae252780c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+15:7130:x1875449976204160:12345-0@lo:502: 00000100:00100000:3.0:1788568564.868832:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae252780c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+15:7130:x1875449976204160:12345-0@lo:502: Request processed in 229us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568564.868839:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788568564.868879:0:7130:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae142aba540 going to sleep for 11 seconds 00000100:00100000:3.0:1788568564.868893:0:7130:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae281709c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:7130:1875449976204160:0@lo:502: 00000020:01000000:3.0:1788568564.868911:0:7130:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788568564.868915:0:7130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788568564.868917:0:7130:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788568564.868920:0:7130:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1788568564.868988:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1788568564.869001:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788568564.869009:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae2429df000/0x41e82f464b6a0bc6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0bcd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568564.869019:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae2429df000/0x41e82f464b6a0bc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0bcd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788568564.869027:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788568564.869030:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ae26b2dcd40 from 1 10000000:01000000:3.0:1788568564.869033:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788568564.869056:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae2429df800/0x41e82f464b6a0be9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568564.869086:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae2429df800/0x41e82f464b6a0be9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568564.869095:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae2429df800/0x41e82f464b6a0be9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568564.869112:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae281709c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976204288:0@lo:101: 00000100:00100000:3.0:1788568564.869137:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568564.869153:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae142aba540 going to sleep for 11 seconds 00000100:00100000:3.0:1788568564.869166:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976204288 00000100:00100000:3.0:1788568564.869169:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976204288 00000100:00100000:3.0:1788568564.869189:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788568564.869196:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae252780850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+15:5838:x1875449976204288:12345-0@lo:101: 00010000:00010000:3.0:1788568564.869204:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568564.869216:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae2429de800/0x41e82f464b6a0bf0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0be9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568564.869238:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae2429de800/0x41e82f464b6a0bf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0be9 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568564.869246:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae2429de800/0x41e82f464b6a0bf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0be9 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568564.869253:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429de800, rc 0) 00000100:00100000:3.0:1788568564.869279:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae252780850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+16:5838:x1875449976204288:12345-0@lo:101: Request processed in 84us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568564.869285:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788568564.869311:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae281709c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976204288:0@lo:101: 00010000:00010000:3.0:1788568564.869330:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae2429df800/0x41e82f464b6a0be9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0bf0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568564.869339:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae2429df800/0x41e82f464b6a0be9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0bf0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568564.869378:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae281709c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976204416:0@lo:501: 00000100:00100000:3.0:1788568564.869402:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568564.869416:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae142aba540 going to sleep for 11 seconds 00000100:00100000:3.0:1788568564.869429:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976204416 00000100:00100000:3.0:1788568564.869432:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976204416 00000100:00100000:3.0:1788568564.869452:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788568564.869458:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+16:5838:x1875449976204416:12345-0@lo:501: 00000100:00100000:3.0:1788568564.869623:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+16:5838:x1875449976204416:12345-0@lo:501: Request processed in 165us (220us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788568564.869629:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788568564.869657:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae281709c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976204416:0@lo:501: 10000000:01000000:3.0:1788568564.869676:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788568564.869681:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae2429df800/0x41e82f464b6a0be9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0bf0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568564.869689:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae2429df800/0x41e82f464b6a0be9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0bf0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568564.873052:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976203776 00000100:00100000:3.0:1788568564.873077:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976203776 00000100:00100000:3.0:1788568564.873121:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788568564.873130:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1875449976203776:12345-0@lo:8: 00010000:00080000:3.0:1788568564.873167:0:6688:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:3.0:1788568564.873195:0:6688:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x41e82f464b6a0bf7 00002000:00100000:3.0:1788568564.873230:0:6688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9ae277a7a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788568564.873235:0:6688:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1788568564.873239:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788568564.873357:0:6688:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788568564.873921:0:6688:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788568564.873979:0:6688:0:(import.c:65:import_set_state_nolock()) ffff9ae277a7f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788568564.874051:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875449976203776:12345-0@lo:8: Request processed in 920us (6026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568564.874071:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788568564.876009:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae281709500 x1875449976203776/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788568574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568564.876024:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788568564.876034:0:3305:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788568564.876042:0:3305:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788568564.876053:0:3305:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788568564.876068:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ae2735ac000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788568564.876082:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788568564.876088:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae281709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875449976203776:0@lo:8: 00000004:00080000:2.0:1788568564.876124:0:7136:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788568564.876456:0:7136:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 199284528267ns, next at 0ns, rc = 0 00010000:00010000:0.0:1788568564.923200:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788568564.942097:0:7137:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788568564.942122:0:7137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae281708e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7137:1875449976204672:0@lo:7: 00000100:00100000:3.0:1788568564.942185:0:7137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568564.942224:0:7137:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae142aba540 going to sleep for 11 seconds 00000004:00080000:3.0:1788568564.942238:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788568564.942270:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae281709c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976204544:0@lo:13: 00000100:00100000:3.0:1788568564.942293:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568564.942327:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976204544 00000100:00100000:3.0:1788568564.942333:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976204544 00000100:00100000:3.0:1788568564.942380:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788568564.942388:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875449976204544:12345-0@lo:13: 00002000:00000024:3.0:1788568564.942416:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1788568564.942452:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875449976204544:12345-0@lo:13: Request processed in 65us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568564.942459:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788568564.942486:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788568564.942508:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae281709c00 x1875449976204544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568580 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568564.942524:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae281709c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976204544:0@lo:13: 00000100:00100000:2.0:1788568564.943095:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976204672 00000100:00100000:2.0:1788568564.943101:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976204672 00000100:00100000:2.0:1788568564.943170:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788568564.943177:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281709500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7137:x1875449976204672:12345-0@lo:7: 00002000:00080000:2.0:1788568564.951634:0:6691:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1788568564.951725:0:6691:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788568564.951819:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281709500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7137:x1875449976204672:12345-0@lo:7: Request processed in 8638us (9630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568564.951830:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788568564.951915:0:7137:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae281708e00 x1875449976204672/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788568580 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568564.952023:0:7137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae281708e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7137:1875449976204672:0@lo:7: 00000004:00080000:3.0:1788568564.952038:0:7137:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788568564.952087:0:7137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae281708e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7137:1875449976204800:0@lo:5: 00000100:00100000:3.0:1788568564.952122:0:7137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568564.952209:0:7137:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae142aba540 going to sleep for 11 seconds 00000100:00100000:2.0:1788568564.952253:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976204800 00000100:00100000:2.0:1788568564.952259:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976204800 00000100:00100000:2.0:1788568564.952304:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788568564.952313:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281709c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7137:x1875449976204800:12345-0@lo:5: 00002000:00080000:2.0:1788568564.952336:0:6690:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788568564.952340:0:6690:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788568564.952734:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281709c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7137:x1875449976204800:12345-0@lo:5: Request processed in 421us (610us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788568564.952742:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788568564.952822:0:7137:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae281708e00 x1875449976204800/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788568580 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568564.952835:0:7137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae281708e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7137:1875449976204800:0@lo:5: 00000004:00080000:3.0:1788568564.952843:0:7137:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788568564.952866:0:7137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae281709f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7137:1875449976204928:0@lo:700: 00000100:00100000:3.0:1788568564.952896:0:7137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568564.952945:0:7137:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae142aba540 going to sleep for 11 seconds 00000100:00100000:2.0:1788568564.953092:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976204928 00000100:00100000:2.0:1788568564.953097:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976204928 00000100:00100000:2.0:1788568564.953127:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788568564.953134:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7137:x1875449976204928:12345-0@lo:700: 00000100:00100000:2.0:1788568564.953173:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6697:1875449976205056:0@lo:700: 00000100:00100000:2.0:1788568564.953215:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568564.953235:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2430f0000 going to sleep for 11 seconds 00000100:00100000:2.0:1788568564.953251:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976205056 00000100:00100000:2.0:1788568564.953254:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976205056 00000100:00100000:2.0:1788568564.953276:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788568564.953282:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6697:x1875449976205056:12345-0@lo:700: 40000000:02000000:1.0:1788568564.980742:0:5849:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1788568564.986805:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6697:x1875449976205056:12345-0@lo:700: Request processed in 33516us (33583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568564.986824:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788568564.986907:0:6697:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae27cce7b80 x1875449976205056/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788568580 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568564.986922:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6697:1875449976205056:0@lo:700: 40000000:02000000:2.0:1788568564.987299:0:6697:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:0.0:1788568565.095896:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1788568565.095920:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788568565.097413:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7137:x1875449976204928:12345-0@lo:700: Request processed in 144202us (144439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568565.097445:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788568565.097529:0:7137:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae281709f80 x1875449976204928/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788568580 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568565.097541:0:7137:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788568565.097558:0:7137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae281709f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7137:1875449976204928:0@lo:700: 00000004:02000040:0.0:1788568565.176117:0:7137:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1788568565.181388:0:7137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf61c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7137:1875449976205184:0@lo:5: 00000100:00100000:0.0:1788568565.181453:0:7137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568565.181502:0:7137:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae252326900 going to sleep for 11 seconds 00000100:00100000:2.0:1788568565.181601:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976205184 00000100:00100000:2.0:1788568565.181609:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976205184 00000100:00100000:2.0:1788568565.181669:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788568565.181679:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7137:x1875449976205184:12345-0@lo:5: 00002000:00080000:0.0:1788568565.203227:0:6691:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788568565.203248:0:6691:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1788568565.209561:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7137:x1875449976205184:12345-0@lo:5: Request processed in 27877us (28101us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788568565.209577:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788568565.210803:0:7137:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae27bf61c00 x1875449976205184/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788568581 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568565.210821:0:7137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf61c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7137:1875449976205184:0@lo:5: 00000004:00080000:1.0:1788568565.210836:0:7137:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1788568565.944230:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568566.969209:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568567.996249:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788568568.429296:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1788568569.015960:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568570.040552:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568570.359399:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae281708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925db6b8-84bc-418c-b37a-40345c1020be:3309:1875449976205312:0@lo:400: 00000100:00100000:3.0:1788568570.359496:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568570.359556:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788568570.359562:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae28170b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976205696:0@lo:400: 00000100:00100000:3.0:1788568570.359606:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568570.359642:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae28170a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976205440:0@lo:400: 00000100:00100000:3.0:1788568570.359671:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568570.359691:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788568570.359696:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae28170a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875449976205568:0@lo:400: 00000100:00100000:3.0:1788568570.359720:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568570.359755:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976205312 00000100:00100000:3.0:1788568570.359763:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976205312 00000100:00100000:3.0:1788568570.359820:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788568570.359831:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+16:3309:x1875449976205312:12345-0@lo:400: 00000100:00100000:3.0:1788568570.359893:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+16:3309:x1875449976205312:12345-0@lo:400: Request processed in 63us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568570.359901:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788568570.359965:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976205440 00000100:00100000:3.0:1788568570.359970:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976205440 00000100:00100000:3.0:1788568570.359997:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976205568 00000100:00100000:3.0:1788568570.360000:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976205568 00000100:00100000:3.0:1788568570.360046:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788568570.360053:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976205440:12345-0@lo:400: 00000100:00100000:3.0:1788568570.360169:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976205440:12345-0@lo:400: Request processed in 116us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568570.360177:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788568570.360192:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788568570.360199:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875449976205568:12345-0@lo:400: 00000100:00100000:3.0:1788568570.360230:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875449976205568:12345-0@lo:400: Request processed in 32us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568570.360236:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788568570.360278:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788568570.360316:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae28170a680 x1875449976205568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568570.360333:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae28170a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875449976205568:0@lo:400: 00010000:00080000:3.0:1788568570.360347:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae28170a300 x1875449976205440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568570.360354:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae28170a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976205440:0@lo:400: 00000100:00100000:3.0:1788568570.360388:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae281708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925db6b8-84bc-418c-b37a-40345c1020be:3309:1875449976205312:0@lo:400: 00000100:00100000:2.0:1788568570.361543:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976205696 00000100:00100000:2.0:1788568570.361557:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976205696 00000100:00100000:2.0:1788568570.361792:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788568570.361806:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae28170ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976205696:12345-0@lo:400: 00000100:00100000:2.0:1788568570.361907:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae28170ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976205696:12345-0@lo:400: Request processed in 106us (2300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568570.361914:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788568570.361959:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788568570.361996:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae28170b480 x1875449976205696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568570.362345:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788568570.362368:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae28170b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976205696:0@lo:400: 00000100:00100000:2.0:1788568570.362391:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae251dc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976205824:0@lo:13: 00000100:00100000:2.0:1788568570.362439:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568570.363221:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976205824 00000100:00100000:1.0:1788568570.363231:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976205824 00000100:00100000:1.0:1788568570.363279:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788568570.363288:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976205824:12345-0@lo:13: 00002000:00000024:1.0:1788568570.363342:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788568570.363404:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976205824:12345-0@lo:13: Request processed in 117us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568570.363410:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788568570.363801:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae251dc6a00 x1875449976205824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568586 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568570.363823:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae251dc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976205824:0@lo:13: 00010000:00010000:3.0:1788568571.067100:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568572.091834:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568573.111276:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568574.137784:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788568574.321213:0:7631:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788568574.321217:0:7631:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788568574.321342:0:7631:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ae277b92800 00000020:01000004:2.0:1788568574.321356:0:7631:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788568574.321368:0:7631:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788568574.321380:0:7631:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9ae248ddb380) 00000020:00000080:2.0:1788568574.321394:0:7631:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788568574.333910:0:7631:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788568574.334295:0:7631:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1788568574.350649:0:7631:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1788568574.355543:0:7631:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788568574.355574:0:7631:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1788568574.355626:0:7631:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788568574.355651:0:7631:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1788568574.356160:0:7631:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788568574.356170:0:7631:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788568574.356183:0:7631:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x41e82f464b6a0c05 00000020:01000004:1.0:1788568574.356190:0:7631:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1788568574.356210:0:7631:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.104@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788568574.356213:0:7631:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788568574.356218:0:7631:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788568574.356238:0:7631:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1788568574.356242:0:7631:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.104@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788568574.371307:0:7631:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.104@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788568574.371340:0:7631:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.104@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1788568574.371343:0:7631:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788568574.371345:0:7631:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788568574.371347:0:7631:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788568574.371348:0:7631:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788568574.371350:0:7631:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788568574.371351:0:7631:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788568574.371353:0:7631:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788568574.371354:0:7631:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788568574.371355:0:7631:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788568574.371357:0:7631:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788568574.371359:0:7631:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788568574.371362:0:7631:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1788568574.371364:0:7631:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788568574.371366:0:7631:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788568574.371367:0:7631:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788568574.371368:0:7631:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788568574.371369:0:7631:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788568574.371370:0:7631:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788568574.371372:0:7631:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788568574.371373:0:7631:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788568574.371374:0:7631:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788568574.371375:0:7631:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788568574.371376:0:7631:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788568574.371407:0:7631:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788568574.371424:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf62a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:7631:1875449976205952:0@lo:253: 00000100:00100000:0.0:1788568574.371498:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568574.371621:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2531170c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788568574.371702:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976205952 00000100:00100000:3.0:1788568574.371710:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976205952 00000100:00100000:3.0:1788568574.371869:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788568574.371880:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+16:7631:x1875449976205952:12345-0@lo:253: 20000000:01000000:3.0:1788568574.371907:0:5834:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788568574.371911:0:5834:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1788568574.371915:0:5834:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1788568574.371918:0:5834:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1788568574.373117:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788568574.376370:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1788568574.376400:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1788568574.376460:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1788568574.376468:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1788568574.376498:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1788568574.376548:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1788568574.377047:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1788568574.377067:0:5834:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.104@tcp 20000000:01000000:3.0:1788568574.377069:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.104@tcp (null) (null) (null) 00000040:00080000:3.0:1788568574.377112:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1788568574.377121:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788568574.377168:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1788568574.377176:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.104@tcp (null) (null) 00000040:00080000:3.0:1788568574.377212:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1788568574.377219:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788568574.377248:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1788568574.377308:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1788568574.378377:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1788568574.378401:0:5834:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.104@tcp 20000000:01000000:3.0:1788568574.378403:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.104@tcp (null) (null) (null) 00000040:00080000:3.0:1788568574.378435:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1788568574.378443:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788568574.378472:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1788568574.378479:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.104@tcp (null) (null) 00000040:00080000:3.0:1788568574.378509:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1788568574.378518:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788568574.378564:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1788568574.378599:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1788568574.378614:0:5834:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788568574.378617:0:5834:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788568574.378620:0:5834:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788568574.378631:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788568574.378633:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788568574.378663:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788568574.378665:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788568574.379394:0:7633:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1788568574.379455:0:7633:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1788568574.379490:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1788568574.379826:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1788568574.379866:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1788568574.379912:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1788568574.380004:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788568574.380015:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788568574.380476:0:7634:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1788568574.380523:0:7634:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1788568574.380576:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1788568574.380891:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1788568574.381082:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1788568574.381119:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1788568574.381132:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788568574.381134:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788568574.381435:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1788568574.381622:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1788568574.381673:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1788568574.381722:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1788568574.381805:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788568574.381808:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788568574.382331:0:7636:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1788568574.382379:0:7636:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1788568574.382428:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1788568574.382653:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1788568574.382688:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1788568574.382809:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1788568574.382826:0:5834:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1788568574.382828:0:5834:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1788568574.382836:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788568574.382854:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0c0c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568574.382871:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae282044e00/0x41e82f464b6a0b5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0b56 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568574.382878:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae282044800/0x41e82f464b6a0b87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0b80 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568574.382885:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae252e7b000/0x41e82f464b6a0bb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0baa expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568574.382892:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae2429de600/0x41e82f464b6a0bcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0bc6 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568574.382898:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae2429de800/0x41e82f464b6a0bf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0be9 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568574.382915:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0c0c lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568574.383069:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae2429de800/0x41e82f464b6a0bf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x41e82f464b6a0be9 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568574.383085:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae2429de800/0x41e82f464b6a0bf0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x41e82f464b6a0be9 expref: 16 pid: 5836 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568574.383097:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae281708700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1875449976206080:0@lo:104: 00000100:00100000:3.0:1788568574.383164:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788568574.383216:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae2429de600/0x41e82f464b6a0bcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x41e82f464b6a0bc6 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568574.383223:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae2429de600/0x41e82f464b6a0bcd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x41e82f464b6a0bc6 expref: 16 pid: 5834 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568574.383232:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae28170a300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1875449976206208:0@lo:104: 00010000:00010000:3.0:1788568574.383253:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae252e7b000/0x41e82f464b6a0bb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x41e82f464b6a0baa expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568574.383260:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae252e7b000/0x41e82f464b6a0bb1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x41e82f464b6a0baa expref: 16 pid: 5834 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568574.383267:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae28170a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1875449976206336:0@lo:104: 00010000:00010000:3.0:1788568574.383286:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae282044800/0x41e82f464b6a0b87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x41e82f464b6a0b80 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568574.383293:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae282044800/0x41e82f464b6a0b87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x41e82f464b6a0b80 expref: 16 pid: 5835 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568574.383307:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae281708e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1875449976206464:0@lo:104: 00010000:00010000:3.0:1788568574.383329:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae282044e00/0x41e82f464b6a0b5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x41e82f464b6a0b56 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568574.383337:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae282044e00/0x41e82f464b6a0b5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x41e82f464b6a0b56 expref: 16 pid: 5835 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568574.383343:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae28170b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1875449976206592:0@lo:104: 00000100:00100000:3.0:1788568574.383357:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae141ef3240 going to sleep for 11 seconds 00000100:00100000:2.0:1788568574.383435:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788568574.383453:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568574.383517:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568574.383586:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568574.383646:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976206080 00000100:00100000:0.0:1788568574.383654:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976206080 00000100:00100000:0.0:1788568574.383689:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976206208 00000100:00100000:0.0:1788568574.383691:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976206208 00000100:00100000:0.0:1788568574.383700:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976206336 00000100:00100000:0.0:1788568574.383701:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976206336 00000100:00100000:0.0:1788568574.383714:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788568574.383723:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae250b1f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:925db6b8-84bc-418c-b37a-40345c1020be+5:5834:x1875449976206080:12345-0@lo:104: 00010000:00010000:0.0:1788568574.383752:0:6704:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.104@tcp lock: ffff9ae2429df800/0x41e82f464b6a0be9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0bf0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.383814:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788568574.383820:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae250b1f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:925db6b8-84bc-418c-b37a-40345c1020be+5:5834:x1875449976206080:12345-0@lo:104: Request processed in 98us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568574.383826:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788568574.383863:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788568574.383869:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cce6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:925db6b8-84bc-418c-b37a-40345c1020be+4:5834:x1875449976206208:12345-0@lo:104: 00010000:00010000:0.0:1788568574.383876:0:6704:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.104@tcp lock: ffff9ae2429df000/0x41e82f464b6a0bc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0bcd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.383904:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788568574.383908:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cce6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:925db6b8-84bc-418c-b37a-40345c1020be+4:5834:x1875449976206208:12345-0@lo:104: Request processed in 41us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568574.383914:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788568574.383950:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788568574.383957:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cce5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:925db6b8-84bc-418c-b37a-40345c1020be+3:5834:x1875449976206336:12345-0@lo:104: 00010000:00010000:0.0:1788568574.383964:0:6704:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.104@tcp lock: ffff9ae2429dfa00/0x41e82f464b6a0baa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0bb1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.383989:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788568574.383995:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cce5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:925db6b8-84bc-418c-b37a-40345c1020be+3:5834:x1875449976206336:12345-0@lo:104: Request processed in 39us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568574.384001:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788568574.384028:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788568574.384033:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae2429df800/0x41e82f464b6a0be9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0bf0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.384045:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429df800 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:0.0:1788568574.384049:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae2429df800/0x41e82f464b6a0be9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x41e82f464b6a0bf0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.384057:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae2429df800/0x41e82f464b6a0be9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x41e82f464b6a0bf0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788568574.384066:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae2429df800/0x41e82f464b6a0be9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x41e82f464b6a0bf0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568574.384072:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788568574.384098:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae2429df800/0x41e82f464b6a0be9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0bf0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.384104:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788568574.384120:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae2429df800/0x41e82f464b6a0be9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0bf0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.384127:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae2429df800/0x41e82f464b6a0be9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0bf0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.384139:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788568574.384143:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae2429df000/0x41e82f464b6a0bc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0bcd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.384148:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429df000 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:0.0:1788568574.384151:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae2429df000/0x41e82f464b6a0bc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x41e82f464b6a0bcd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.384168:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae2429df000/0x41e82f464b6a0bc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x41e82f464b6a0bcd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788568574.384174:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae2429df000/0x41e82f464b6a0bc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x41e82f464b6a0bcd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568574.384179:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788568574.384191:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae2429df000/0x41e82f464b6a0bc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0bcd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.384196:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788568574.384201:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae2429df000/0x41e82f464b6a0bc6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0bcd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.384208:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae2429df000/0x41e82f464b6a0bc6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0bcd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.384217:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788568574.384220:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae2429dfa00/0x41e82f464b6a0baa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0bb1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.384226:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429dfa00 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:0.0:1788568574.384228:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae2429dfa00/0x41e82f464b6a0baa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x41e82f464b6a0bb1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.384234:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae2429dfa00/0x41e82f464b6a0baa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x41e82f464b6a0bb1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788568574.384240:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae2429dfa00/0x41e82f464b6a0baa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x41e82f464b6a0bb1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568574.384250:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788568574.384262:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae2429dfa00/0x41e82f464b6a0baa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0bb1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.384268:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788568574.384283:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae2429dfa00/0x41e82f464b6a0baa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0bb1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.384289:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae2429dfa00/0x41e82f464b6a0baa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0bb1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.384298:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568574.384300:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568574.384301:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568574.384307:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568574.384327:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976206720:0@lo:103: 00000100:00100000:0.0:1788568574.384356:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568574.384377:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788568574.384382:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976206848:0@lo:103: 00000100:00100000:0.0:1788568574.384398:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568574.384422:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:925db6b8-84bc-418c-b37a-40345c1020be:3308:1875449976206976:0@lo:103: 00000100:00100000:0.0:1788568574.384441:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568574.384472:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976206720 00000100:00100000:0.0:1788568574.384476:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976206720 00010000:00010000:0.0:1788568574.384494:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae2429de800/0x41e82f464b6a0bf0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0be9 expref: 17 pid: 5836 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568574.384514:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976206848 00000100:00100000:0.0:1788568574.384522:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976206848 00010000:00010000:0.0:1788568574.384535:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae2429de600/0x41e82f464b6a0bcd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0bc6 expref: 18 pid: 5834 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568574.384547:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976206976 00000100:00100000:0.0:1788568574.384550:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976206976 00010000:00010000:0.0:1788568574.384558:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae252e7b000/0x41e82f464b6a0bb1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0baa expref: 19 pid: 5834 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568574.384568:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788568574.384573:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:925db6b8-84bc-418c-b37a-40345c1020be+19:3306:x1875449976206720:12345-0@lo:103: 00010000:00010000:0.0:1788568574.384581:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568574.384585:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae2429de800/0x41e82f464b6a0bf0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0be9 expref: 19 pid: 5836 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.384595:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae2429de800/0x41e82f464b6a0bf0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x41e82f464b6a0be9 expref: 19 pid: 5836 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.384609:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788568574.384635:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:925db6b8-84bc-418c-b37a-40345c1020be+19:3306:x1875449976206720:12345-0@lo:103: Request processed in 61us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568574.384641:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788568574.384652:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788568574.384658:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:925db6b8-84bc-418c-b37a-40345c1020be+18:3306:x1875449976206848:12345-0@lo:103: 00010000:00010000:0.0:1788568574.384664:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568574.384668:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae2429de600/0x41e82f464b6a0bcd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0bc6 expref: 18 pid: 5834 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.384676:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae2429de600/0x41e82f464b6a0bcd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x41e82f464b6a0bc6 expref: 18 pid: 5834 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.384694:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788568574.384713:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:925db6b8-84bc-418c-b37a-40345c1020be+18:3306:x1875449976206848:12345-0@lo:103: Request processed in 56us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568574.384719:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788568574.384730:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788568574.384735:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:925db6b8-84bc-418c-b37a-40345c1020be+17:3308:x1875449976206976:12345-0@lo:103: 00010000:00010000:0.0:1788568574.384741:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568574.384745:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae252e7b000/0x41e82f464b6a0bb1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0baa expref: 17 pid: 5834 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.384753:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae252e7b000/0x41e82f464b6a0bb1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x41e82f464b6a0baa expref: 17 pid: 5834 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.384761:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788568574.384781:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:925db6b8-84bc-418c-b37a-40345c1020be+17:3308:x1875449976206976:12345-0@lo:103: Request processed in 47us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568574.384787:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788568574.384821:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:925db6b8-84bc-418c-b37a-40345c1020be:3308:1875449976206976:0@lo:103: 00000100:00100000:0.0:1788568574.384840:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976206848:0@lo:103: 00000100:00100000:0.0:1788568574.384846:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976206720:0@lo:103: 00010000:00010000:1.0:1788568574.384974:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae2429de800/0x41e82f464b6a0bf0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x41e82f464b6a0be9 expref: 16 pid: 5836 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568574.384985:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae281708700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1875449976206080:0@lo:104: 00010000:00010000:1.0:1788568574.384995:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae2429de600/0x41e82f464b6a0bcd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x41e82f464b6a0bc6 expref: 15 pid: 5834 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568574.385003:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae28170a300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1875449976206208:0@lo:104: 00010000:00010000:1.0:1788568574.385025:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae252e7b000/0x41e82f464b6a0bb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x41e82f464b6a0baa expref: 14 pid: 5834 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568574.385032:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae28170a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1875449976206336:0@lo:104: 00000100:00100000:2.0:1788568574.385271:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568574.385282:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976206464 00000100:00100000:2.0:1788568574.385286:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976206464 00000100:00100000:2.0:1788568574.385306:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976206592 00000100:00100000:2.0:1788568574.385308:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976206592 00000100:00100000:2.0:1788568574.385317:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788568574.385323:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cce6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:925db6b8-84bc-418c-b37a-40345c1020be+4:5834:x1875449976206464:12345-0@lo:104: 00010000:00010000:2.0:1788568574.385332:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.104@tcp lock: ffff9ae240031a00/0x41e82f464b6a0b80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0b87 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568574.385415:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788568574.385421:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cce6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:925db6b8-84bc-418c-b37a-40345c1020be+4:5834:x1875449976206464:12345-0@lo:104: Request processed in 98us (1835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568574.385427:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788568574.385440:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788568574.385445:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cce7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:925db6b8-84bc-418c-b37a-40345c1020be+3:5834:x1875449976206592:12345-0@lo:104: 00010000:00010000:2.0:1788568574.385452:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b600/0x41e82f464b6a0b56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0b5d expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568574.385482:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788568574.385486:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cce7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:925db6b8-84bc-418c-b37a-40345c1020be+3:5834:x1875449976206592:12345-0@lo:104: Request processed in 42us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568574.385491:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788568574.385545:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788568574.385550:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae240031a00/0x41e82f464b6a0b80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0b87 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.385557:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae240031a00 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:0.0:1788568574.385560:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae240031a00/0x41e82f464b6a0b80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x41e82f464b6a0b87 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.385574:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae240031a00/0x41e82f464b6a0b80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x41e82f464b6a0b87 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788568574.385582:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae240031a00/0x41e82f464b6a0b80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x41e82f464b6a0b87 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568574.385588:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788568574.385618:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae240031a00/0x41e82f464b6a0b80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0b87 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.385624:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788568574.385636:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae240031a00/0x41e82f464b6a0b80 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0b87 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.385643:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae240031a00/0x41e82f464b6a0b80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0b87 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.385653:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788568574.385656:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b600/0x41e82f464b6a0b56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0b5d expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.385662:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7b600 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:0.0:1788568574.385664:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b600/0x41e82f464b6a0b56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x41e82f464b6a0b5d expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.385670:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b600/0x41e82f464b6a0b56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x41e82f464b6a0b5d expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788568574.385676:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b600/0x41e82f464b6a0b56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x41e82f464b6a0b5d expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568574.385686:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788568574.385698:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b600/0x41e82f464b6a0b56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0b5d expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.385703:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788568574.385713:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b600/0x41e82f464b6a0b56 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0b5d expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.385720:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b600/0x41e82f464b6a0b56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0b5d expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.385744:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568574.385746:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568574.385748:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568574.385759:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925db6b8-84bc-418c-b37a-40345c1020be:3309:1875449976207104:0@lo:103: 00000100:00100000:0.0:1788568574.385786:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568574.385817:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788568574.385824:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925db6b8-84bc-418c-b37a-40345c1020be:3307:1875449976207232:0@lo:103: 00000100:00100000:0.0:1788568574.385842:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568574.385862:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976207104 00000100:00100000:0.0:1788568574.385866:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976207104 00010000:00010000:0.0:1788568574.385880:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae282044800/0x41e82f464b6a0b87 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0b80 expref: 14 pid: 5835 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568574.385894:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976207232 00000100:00100000:0.0:1788568574.385897:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976207232 00010000:00010000:0.0:1788568574.385905:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae282044e00/0x41e82f464b6a0b5d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0b56 expref: 15 pid: 5835 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568574.385952:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788568574.385959:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:925db6b8-84bc-418c-b37a-40345c1020be+15:3309:x1875449976207104:12345-0@lo:103: 00010000:00010000:0.0:1788568574.385969:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568574.385973:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae282044800/0x41e82f464b6a0b87 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0b80 expref: 15 pid: 5835 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.385982:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae282044800/0x41e82f464b6a0b87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x41e82f464b6a0b80 expref: 15 pid: 5835 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.385994:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788568574.386030:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:925db6b8-84bc-418c-b37a-40345c1020be+15:3309:x1875449976207104:12345-0@lo:103: Request processed in 72us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568574.386036:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788568574.386048:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788568574.386054:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:925db6b8-84bc-418c-b37a-40345c1020be+14:3307:x1875449976207232:12345-0@lo:103: 00010000:00010000:0.0:1788568574.386061:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568574.386065:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae282044e00/0x41e82f464b6a0b5d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0b56 expref: 14 pid: 5835 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.386073:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae282044e00/0x41e82f464b6a0b5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x41e82f464b6a0b56 expref: 14 pid: 5835 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.386084:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0c0c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.386092:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0c0c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.386115:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0c0c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.386122:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0c0c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.386128:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0c0c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.386135:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0c0c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.386140:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429dee00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788568574.386144:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0c0c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.386151:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0c0c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.386163:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0c0c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.386172:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788568574.386198:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:925db6b8-84bc-418c-b37a-40345c1020be+14:3307:x1875449976207232:12345-0@lo:103: Request processed in 144us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568574.386203:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788568574.386232:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925db6b8-84bc-418c-b37a-40345c1020be:3307:1875449976207232:0@lo:103: 00000100:00100000:0.0:1788568574.386250:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925db6b8-84bc-418c-b37a-40345c1020be:3309:1875449976207104:0@lo:103: 00010000:00010000:0.0:1788568574.386264:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568574.386534:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae282044800/0x41e82f464b6a0b87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x41e82f464b6a0b80 expref: 13 pid: 5835 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568574.386546:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae281708e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1875449976206464:0@lo:104: 00010000:00010000:1.0:1788568574.386556:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae282044e00/0x41e82f464b6a0b5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x41e82f464b6a0b56 expref: 12 pid: 5835 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568574.386564:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae28170b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1875449976206592:0@lo:104: 00010000:00010000:1.0:1788568574.386589:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0c0c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568574.386598:0:5834:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0c0c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568574.386605:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0c0c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568574.386622:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0c0c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788568574.386636:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788568574.424965:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+11:7631:x1875449976205952:12345-0@lo:253: Request processed in 53079us (53459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568574.424979:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788568574.425101:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf62a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:7631:1875449976205952:0@lo:253: 10000000:01000000:0.0:1788568574.425118:0:7631:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788568574.425122:0:7631:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788568574.425124:0:7631:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788568574.425125:0:7631:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788568574.425126:0:7631:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1788568574.425128:0:7631:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788568574.425129:0:7631:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788568574.425130:0:7631:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788568574.425132:0:7631:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788568574.425134:0:7631:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788568574.425135:0:7631:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788568574.425154:0:7631:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ae277b92800 from lustre-OST0001 10000000:01000000:0.0:1788568574.425178:0:7631:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788568574.425181:0:7631:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788568574.425188:0:7631:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ae26b2dcd40 local copy 10000000:01000000:0.0:1788568574.425191:0:7631:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788568574.425222:0:7631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae240031a00/0x41e82f464b6a0c13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.425233:0:7631:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.104@tcp lock: ffff9ae240031a00/0x41e82f464b6a0c13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.425243:0:7631:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae240031a00/0x41e82f464b6a0c13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568574.425260:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf62a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:7631:1875449976207360:0@lo:101: 00000100:00100000:0.0:1788568574.425294:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568574.425331:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae250ae4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788568574.425387:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976207360 00000100:00100000:1.0:1788568574.425393:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976207360 00000100:00100000:1.0:1788568574.425429:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788568574.425437:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+11:7631:x1875449976207360:12345-0@lo:101: 00010000:00010000:1.0:1788568574.425448:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568574.425461:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae282044e00/0x41e82f464b6a0c1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0c13 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568574.425482:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae282044e00/0x41e82f464b6a0c1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0c13 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568574.425492:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae282044e00/0x41e82f464b6a0c1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0c13 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568574.425501:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae282044e00, rc 0) 00000100:00100000:1.0:1788568574.425538:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+12:7631:x1875449976207360:12345-0@lo:101: Request processed in 101us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568574.425544:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788568574.425644:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf62a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:7631:1875449976207360:0@lo:101: 00010000:00010000:2.0:1788568574.425656:0:7631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae240031a00/0x41e82f464b6a0c13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x41e82f464b6a0c1a expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568574.425666:0:7631:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae240031a00/0x41e82f464b6a0c13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x41e82f464b6a0c1a expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568574.425792:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:7631:1875449976207488:0@lo:501: 00000100:00100000:2.0:1788568574.425818:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568574.425874:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27fd4db40 going to sleep for 11 seconds 00000100:00100000:0.0:1788568574.426004:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976207488 00000100:00100000:0.0:1788568574.426019:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976207488 00000100:00100000:0.0:1788568574.426040:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788568574.426046:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+12:7631:x1875449976207488:12345-0@lo:501: 00000100:00100000:0.0:1788568574.426330:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+12:7631:x1875449976207488:12345-0@lo:501: Request processed in 282us (510us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788568574.426338:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788568574.426426:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:7631:1875449976207488:0@lo:501: 10000000:01000000:2.0:1788568574.426439:0:7631:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788568574.426464:0:7631:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788568574.426469:0:7631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae240031a00/0x41e82f464b6a0c13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x41e82f464b6a0c1a expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568574.426477:0:7631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae240031a00/0x41e82f464b6a0c13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x41e82f464b6a0c1a expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568574.426484:0:7631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.104@tcp lock: ffff9ae240031a00/0x41e82f464b6a0c13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x41e82f464b6a0c1a expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568574.426541:0:7631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788568574.426561:0:7631:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ae277b92800 10000000:01000000:2.0:1788568574.426566:0:7631:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788568574.426570:0:7631:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788568574.426573:0:7631:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788568574.426577:0:7631:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788568574.426579:0:7631:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788568574.426596:0:7631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7bc00/0x41e82f464b6a0c21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568574.426603:0:7631:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae252e7bc00/0x41e82f464b6a0c21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568574.426611:0:7631:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae252e7bc00/0x41e82f464b6a0c21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568574.426623:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:7631:1875449976207616:0@lo:101: 00000100:00100000:2.0:1788568574.426650:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568574.426685:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27fd4d900 going to sleep for 11 seconds 00000100:00100000:3.0:1788568574.426799:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976207616 00000100:00100000:3.0:1788568574.426804:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976207616 00000100:00100000:3.0:1788568574.426834:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788568574.426842:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+12:7631:x1875449976207616:12345-0@lo:101: 00010000:00010000:3.0:1788568574.426850:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568574.426860:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae2429dfe00/0x41e82f464b6a0c28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0c21 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568574.426877:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae2429dfe00/0x41e82f464b6a0c28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0c21 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568574.426885:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae2429dfe00/0x41e82f464b6a0c28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0c21 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568574.426892:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429dfe00, rc 0) 00000100:00100000:3.0:1788568574.426950:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+13:7631:x1875449976207616:12345-0@lo:101: Request processed in 109us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568574.426957:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788568574.427045:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:7631:1875449976207616:0@lo:101: 00010000:00010000:1.0:1788568574.427056:0:7631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae252e7bc00/0x41e82f464b6a0c21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0c28 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568574.427064:0:7631:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae252e7bc00/0x41e82f464b6a0c21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0c28 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568574.427132:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae251dc7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:7631:1875449976207744:0@lo:501: 00000100:00100000:1.0:1788568574.427156:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568574.427180:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24514c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788568574.427228:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976207744 00000100:00100000:3.0:1788568574.427233:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976207744 00010000:00010000:0.0:1788568574.427335:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788568574.427341:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae240031a00/0x41e82f464b6a0c13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x41e82f464b6a0c1a expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.427348:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae240031a00 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:0.0:1788568574.427352:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae240031a00/0x41e82f464b6a0c13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x41e82f464b6a0c1a expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.427360:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae240031a00/0x41e82f464b6a0c13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x41e82f464b6a0c1a expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788568574.427367:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae240031a00/0x41e82f464b6a0c13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x41e82f464b6a0c1a expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568574.427373:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788568574.427393:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae240031a00/0x41e82f464b6a0c13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x41e82f464b6a0c1a expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.427398:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788568574.427414:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae240031a00/0x41e82f464b6a0c13 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x41e82f464b6a0c1a expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.427421:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae240031a00/0x41e82f464b6a0c13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x41e82f464b6a0c1a expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.427434:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568574.427435:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568574.427445:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568574.427457:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925db6b8-84bc-418c-b37a-40345c1020be:3307:1875449976207872:0@lo:103: 00000100:00100000:0.0:1788568574.427490:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568574.427524:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976207872 00000100:00100000:0.0:1788568574.427528:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976207872 00000100:00100000:0.0:1788568574.427554:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788568574.427560:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:925db6b8-84bc-418c-b37a-40345c1020be+14:3307:x1875449976207872:12345-0@lo:103: 00010000:00010000:0.0:1788568574.427569:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568574.427580:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae282044e00/0x41e82f464b6a0c1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x41e82f464b6a0c13 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.427589:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788568574.427614:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:925db6b8-84bc-418c-b37a-40345c1020be+13:3307:x1875449976207872:12345-0@lo:103: Request processed in 55us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568574.427621:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788568574.427648:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925db6b8-84bc-418c-b37a-40345c1020be:3307:1875449976207872:0@lo:103: 00000100:00100000:3.0:1788568574.427693:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788568574.427701:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+12:7631:x1875449976207744:12345-0@lo:501: 00000100:00100000:3.0:1788568574.427952:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+12:7631:x1875449976207744:12345-0@lo:501: Request processed in 252us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568574.427959:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788568574.428049:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae251dc7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:7631:1875449976207744:0@lo:501: 00000100:00100000:0.0:1788568574.428075:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf61180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:7631:1875449976208000:0@lo:503: 00000100:00100000:0.0:1788568574.428111:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568574.428356:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae250ae46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788568574.428384:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976208000 00000100:00100000:1.0:1788568574.428389:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976208000 00000100:00100000:1.0:1788568574.428412:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788568574.428418:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+12:7631:x1875449976208000:12345-0@lo:503: 00000100:00100000:1.0:1788568574.428560:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+12:7631:x1875449976208000:12345-0@lo:503: Request processed in 141us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568574.428567:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788568574.428652:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf61180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:7631:1875449976208000:0@lo:503: 00000040:00080000:0.0:1788568574.428894:0:7631:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788568574.428989:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf61180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:7631:1875449976208128:0@lo:502: 00000100:00100000:0.0:1788568574.429040:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568574.429058:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae250ae46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788568574.429163:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976208128 00000100:00100000:1.0:1788568574.429168:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976208128 00000100:00100000:1.0:1788568574.429187:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788568574.429193:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+12:7631:x1875449976208128:12345-0@lo:502: 00000100:00100000:1.0:1788568574.429324:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+12:7631:x1875449976208128:12345-0@lo:502: Request processed in 130us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568574.429331:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788568574.429404:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf61180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:7631:1875449976208128:0@lo:502: 00000040:00080000:0.0:1788568574.429650:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788568574.429693:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788568574.429724:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788568574.429840:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788568574.429874:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788568574.429901:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788568574.430060:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf61180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:7631:1875449976208256:0@lo:502: 00000100:00100000:1.0:1788568574.430166:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568574.430199:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae250ae46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788568574.430253:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976208256 00000100:00100000:2.0:1788568574.430259:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976208256 00000100:00100000:2.0:1788568574.430286:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788568574.430293:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+12:7631:x1875449976208256:12345-0@lo:502: 00000100:00100000:2.0:1788568574.430435:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+12:7631:x1875449976208256:12345-0@lo:502: Request processed in 142us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568574.430442:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788568574.430591:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf61180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:7631:1875449976208256:0@lo:502: 00000040:00080000:1.0:1788568574.430680:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788568574.430690:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1788568574.431284:0:7638:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788568574.431292:0:7638:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1788568574.431298:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788568574.431301:0:7638:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788568574.431306:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788568574.431320:0:7638:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9ae27bbc3380) 00000020:00000080:0.0:1788568574.431339:0:7638:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788568574.431345:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788568574.431409:0:7638:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ae277b92800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788568574.431416:0:7638:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788568574.431422:0:7638:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x41e82f464b6a0c36 00010000:00010000:1.0:1788568574.435095:0:7638:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1788568574.435377:0:7638:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1788568574.437908:0:7638:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788568574.438248:0:7638:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1788568574.441885:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1788568574.442518:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1788568574.443701:0:7638:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788568574.443711:0:7638:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788568574.443716:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568574.443719:0:7638:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788568574.443722:0:7638:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788568574.443725:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568574.443727:0:7638:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788568574.443730:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788568574.443732:0:7638:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788568574.443785:0:7638:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788568574.443788:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568574.443790:0:7638:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788568574.443793:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788568574.443992:0:7631:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1788568574.444028:0:7631:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788568574.444051:0:7631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7bc00/0x41e82f464b6a0c21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0c28 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568574.444063:0:7631:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae252e7bc00/0x41e82f464b6a0c21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0c28 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788568574.444071:0:7631:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae277b92800 from 1 10000000:01000000:2.0:1788568574.444074:0:7631:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788568574.444105:0:7631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7be00/0x41e82f464b6a0c3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568574.444113:0:7631:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae252e7be00/0x41e82f464b6a0c3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568574.444123:0:7631:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae252e7be00/0x41e82f464b6a0c3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568574.444143:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:7631:1875449976208384:0@lo:101: 00000100:00100000:2.0:1788568574.444200:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568574.444239:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27fd4d900 going to sleep for 11 seconds 00000100:00100000:1.0:1788568574.444360:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976208384 00000100:00100000:1.0:1788568574.444367:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976208384 00000100:00100000:1.0:1788568574.444399:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788568574.444407:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+12:7631:x1875449976208384:12345-0@lo:101: 00010000:00010000:1.0:1788568574.444418:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568574.444429:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae282044800/0x41e82f464b6a0c44 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0c3d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568574.444448:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae282044800/0x41e82f464b6a0c44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0c3d expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568574.444458:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae282044800/0x41e82f464b6a0c44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0c3d expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568574.444466:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae282044800, rc 0) 00000100:00100000:1.0:1788568574.444509:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+13:7631:x1875449976208384:12345-0@lo:101: Request processed in 102us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568574.444520:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788568574.444618:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:7631:1875449976208384:0@lo:101: 00010000:00010000:2.0:1788568574.444632:0:7631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae252e7be00/0x41e82f464b6a0c3d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0c44 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568574.444641:0:7631:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae252e7be00/0x41e82f464b6a0c3d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0c44 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568574.444711:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:7631:1875449976208512:0@lo:501: 00000100:00100000:2.0:1788568574.444796:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568574.444821:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27fd4d900 going to sleep for 11 seconds 00000100:00100000:0.0:1788568574.444864:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976208512 00000100:00100000:0.0:1788568574.444869:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976208512 00000100:00100000:0.0:1788568574.444896:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788568574.444902:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+13:7631:x1875449976208512:12345-0@lo:501: 00000100:00100000:0.0:1788568574.445128:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+13:7631:x1875449976208512:12345-0@lo:501: Request processed in 224us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568574.445135:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788568574.445221:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:7631:1875449976208512:0@lo:501: 00000100:00100000:2.0:1788568574.445245:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:7631:1875449976208640:0@lo:503: 00000100:00100000:2.0:1788568574.445279:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568574.445292:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27fd4d900 going to sleep for 11 seconds 00000100:00100000:0.0:1788568574.445349:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976208640 00000100:00100000:0.0:1788568574.445353:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976208640 00000100:00100000:0.0:1788568574.445383:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788568574.445390:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+13:7631:x1875449976208640:12345-0@lo:503: 00000100:00100000:0.0:1788568574.445658:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+13:7631:x1875449976208640:12345-0@lo:503: Request processed in 267us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568574.445664:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788568574.445891:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:7631:1875449976208640:0@lo:503: 00000040:00080000:2.0:1788568574.446200:0:7631:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788568574.446255:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:7631:1875449976208768:0@lo:502: 00000100:00100000:2.0:1788568574.446290:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568574.446322:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27fd4d900 going to sleep for 11 seconds 00000100:00100000:2.0:1788568574.446338:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976208768 00000100:00100000:2.0:1788568574.446342:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976208768 00000100:00100000:2.0:1788568574.446368:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788568574.446374:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+13:7631:x1875449976208768:12345-0@lo:502: 00000100:00100000:2.0:1788568574.446516:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+13:7631:x1875449976208768:12345-0@lo:502: Request processed in 141us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568574.446523:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788568574.446566:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:7631:1875449976208768:0@lo:502: 00000040:00080000:2.0:1788568574.446896:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788568574.446999:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788568574.447033:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:7631:1875449976208896:0@lo:502: 00000100:00100000:2.0:1788568574.447065:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568574.447172:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27fd4d900 going to sleep for 11 seconds 00000100:00100000:0.0:1788568574.448129:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976208896 00000100:00100000:0.0:1788568574.448137:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976208896 00000100:00100000:0.0:1788568574.448177:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788568574.448185:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+13:7631:x1875449976208896:12345-0@lo:502: 00000100:00100000:0.0:1788568574.448377:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+13:7631:x1875449976208896:12345-0@lo:502: Request processed in 192us (1310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568574.448384:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788568574.448469:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:7631:1875449976208896:0@lo:502: 00000040:00080000:3.0:1788568574.448581:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788568574.448594:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788568574.449182:0:7641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788568574.449191:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568574.449194:0:7641:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788568574.449200:0:7641:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ae277b92800 00000020:00000080:1.0:1788568574.449203:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788568574.449217:0:7641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788568574.449220:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568574.449222:0:7641:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788568574.449224:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788568574.449330:0:7631:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788568574.449347:0:7631:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788568574.449368:0:7631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7be00/0x41e82f464b6a0c3d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0c44 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568574.449379:0:7631:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae252e7be00/0x41e82f464b6a0c3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0c44 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788568574.449416:0:7631:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788568574.449419:0:7631:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ae277b92800 10000000:01000000:3.0:1788568574.449422:0:7631:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ae277b92800 10000000:01000000:3.0:1788568574.449425:0:7631:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788568574.449430:0:7631:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ae277b92800 from 1 10000000:01000000:3.0:1788568574.449432:0:7631:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788568574.449459:0:7631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae2429dea00/0x41e82f464b6a0c4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568574.449467:0:7631:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae2429dea00/0x41e82f464b6a0c4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568574.449487:0:7631:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae2429dea00/0x41e82f464b6a0c4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568574.449504:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae28170b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:7631:1875449976209024:0@lo:101: 00000100:00100000:3.0:1788568574.449548:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568574.449576:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae141ef3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788568574.449633:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976209024 00000100:00100000:0.0:1788568574.449639:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976209024 00000100:00100000:0.0:1788568574.449667:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788568574.449673:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+13:7631:x1875449976209024:12345-0@lo:101: 00010000:00010000:0.0:1788568574.449684:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568574.449695:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae240031a00/0x41e82f464b6a0c52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0c4b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.449714:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae240031a00/0x41e82f464b6a0c52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0c4b expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.449724:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae240031a00/0x41e82f464b6a0c52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0c4b expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568574.449732:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae240031a00, rc 0) 00000100:00100000:0.0:1788568574.449839:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+14:7631:x1875449976209024:12345-0@lo:101: Request processed in 165us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568574.449845:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788568574.450025:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae28170b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:7631:1875449976209024:0@lo:101: 00010000:00010000:3.0:1788568574.450038:0:7631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae2429dea00/0x41e82f464b6a0c4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0c52 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568574.450047:0:7631:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae2429dea00/0x41e82f464b6a0c4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0c52 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568574.450113:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae28170b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:7631:1875449976209152:0@lo:501: 00000100:00100000:3.0:1788568574.450137:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568574.450162:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae141ef3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788568574.450201:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976209152 00000100:00100000:1.0:1788568574.450205:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976209152 00000100:00100000:1.0:1788568574.450226:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788568574.450232:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+14:7631:x1875449976209152:12345-0@lo:501: 00000100:00100000:1.0:1788568574.450421:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+14:7631:x1875449976209152:12345-0@lo:501: Request processed in 188us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568574.450428:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788568574.450522:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae28170b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:7631:1875449976209152:0@lo:501: 00000100:00100000:3.0:1788568574.450548:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae28170b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:7631:1875449976209280:0@lo:503: 00000100:00100000:3.0:1788568574.450583:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568574.450604:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae141ef3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788568574.450651:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976209280 00000100:00100000:0.0:1788568574.450655:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976209280 00000100:00100000:0.0:1788568574.450684:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788568574.450691:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+14:7631:x1875449976209280:12345-0@lo:503: 00000100:00100000:0.0:1788568574.450889:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+14:7631:x1875449976209280:12345-0@lo:503: Request processed in 198us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568574.450896:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788568574.451093:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae28170b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:7631:1875449976209280:0@lo:503: 00000040:00080000:3.0:1788568574.451336:0:7631:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788568574.451385:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae28170b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:7631:1875449976209408:0@lo:502: 00000100:00100000:3.0:1788568574.451425:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568574.451458:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae141ef3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788568574.451833:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976209408 00000100:00100000:0.0:1788568574.451839:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976209408 00000100:00100000:0.0:1788568574.451873:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788568574.451880:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+14:7631:x1875449976209408:12345-0@lo:502: 00000100:00100000:0.0:1788568574.452088:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+14:7631:x1875449976209408:12345-0@lo:502: Request processed in 207us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568574.452095:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788568574.452224:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae28170b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:7631:1875449976209408:0@lo:502: 00000040:00080000:3.0:1788568574.452463:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788568574.452511:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788568574.452546:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788568574.452591:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788568574.452622:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788568574.452669:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788568574.452703:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788568574.452730:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788568574.455265:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788568574.455312:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788568574.455342:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788568574.455383:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788568574.455413:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788568574.455440:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788568574.455483:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788568574.455513:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788568574.455540:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788568574.455581:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788568574.455613:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788568574.455644:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788568574.455700:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788568574.455809:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788568574.455848:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788568574.455894:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788568574.455946:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788568574.455981:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788568574.456039:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788568574.456075:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1788568574.456106:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788568574.456153:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1788568574.456188:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1788568574.456219:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1788568574.456250:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1788568574.456311:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1788568574.456346:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1788568574.456392:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1788568574.456425:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1788568574.456472:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:7631:1875449976209536:0@lo:502: 00000100:00100000:2.0:1788568574.456547:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568574.456594:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27fd4d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788568574.456692:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976209536 00000100:00100000:1.0:1788568574.456700:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976209536 00000100:00100000:1.0:1788568574.456752:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788568574.456761:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+14:7631:x1875449976209536:12345-0@lo:502: 00000100:00100000:1.0:1788568574.456972:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+14:7631:x1875449976209536:12345-0@lo:502: Request processed in 212us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568574.456979:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788568574.457039:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:7631:1875449976209536:0@lo:502: 00000040:00080000:1.0:1788568574.457100:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1788568574.457110:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1788568574.460876:0:7643:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788568574.460894:0:7643:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9ae248dd8000) 00000020:00000080:2.0:1788568574.460913:0:7643:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1788568574.461023:0:7643:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ae277b92800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788568574.461027:0:7643:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ae277b92800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788568574.461030:0:7643:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae277b92800 3 00010000:00080000:2.0:1788568574.461058:0:7643:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae27ff27000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.104@tcp at head 00010000:00010000:2.0:1788568574.464386:0:7643:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1788568574.464571:0:7643:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788568574.464605:0:7643:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788568574.464617:0:7643:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x41e82f464b6a0c60 00000100:00080000:2.0:1788568574.464627:0:7643:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788568574.464633:0:7643:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ae27ff27000 using connection 192.168.206.104@tcp/0@lo 00000100:00100000:2.0:1788568574.464664:0:7643:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae27cce6a00 x1875449976209664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788568574.464694:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1875449976209664:0@lo:38: 00000100:00080000:0.0:1788568574.465873:0:7643:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788568574.465972:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568574.467108:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976209664 00000100:00100000:0.0:1788568574.467119:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976209664 00000100:00100000:0.0:1788568574.467157:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788568574.467166:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cce4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1875449976209664:12345-0@lo:38: 00010000:00080000:0.0:1788568574.467191:0:5844:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:0.0:1788568574.467225:0:5844:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x41e82f464b6a0c67 00000004:00100000:0.0:1788568574.467239:0:5844:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788568574.467270:0:5844:0:(import.c:65:import_set_state_nolock()) ffff9ae26f6f8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788568574.467338:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cce4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875449976209664:12345-0@lo:38: Request processed in 172us (1367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568574.467346:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788568574.467521:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae27cce6a00 x1875449976209664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788568584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568574.467532:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788568574.467539:0:3305:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1788568574.467553:0:3305:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788568574.467558:0:3305:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788568574.467561:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ae27ff27000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788568574.467567:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1875449976209664:0@lo:38: 00000100:00100000:0.0:1788568574.470070:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875449976209792:0@lo:400: 00000100:00100000:0.0:1788568574.470134:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568574.470170:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788568574.470176:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976209920:0@lo:400: 00000100:00100000:0.0:1788568574.470200:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568574.470230:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976210048:0@lo:400: 00000100:00100000:0.0:1788568574.470254:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568574.470289:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976209792 00000100:00100000:0.0:1788568574.470296:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976209792 00000100:00100000:0.0:1788568574.470330:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976209920 00000100:00100000:0.0:1788568574.470334:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976209920 00000100:00100000:0.0:1788568574.470368:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788568574.470377:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875449976209792:12345-0@lo:400: 00000100:00100000:0.0:1788568574.470424:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875449976209792:12345-0@lo:400: Request processed in 49us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568574.470431:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788568574.470447:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788568574.470454:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976209920:12345-0@lo:400: 00000100:00100000:0.0:1788568574.470481:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976209920:12345-0@lo:400: Request processed in 28us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568574.470486:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788568574.470504:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976210048 00000100:00100000:0.0:1788568574.470507:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976210048 00000100:00100000:0.0:1788568574.470532:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788568574.470538:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976210048:12345-0@lo:400: 00000100:00100000:0.0:1788568574.470571:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976210048:12345-0@lo:400: Request processed in 34us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568574.470576:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788568574.470617:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae27bf62a00 x1875449976210048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568574.470630:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976210048:0@lo:400: 00010000:00080000:0.0:1788568574.470659:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae27bf61180 x1875449976209920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568574.470668:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976209920:0@lo:400: 00010000:00080000:0.0:1788568574.470694:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae27bf63100 x1875449976209792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568574.470701:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875449976209792:0@lo:400: 00000100:00080000:0.0:1788568574.470992:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788568574.470997:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1788568574.473070:0:7643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1788568574.473233:0:7631:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1788568574.473257:0:7631:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788568574.473275:0:7631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae2429dea00/0x41e82f464b6a0c4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0c52 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568574.473286:0:7631:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae2429dea00/0x41e82f464b6a0c4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0c52 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788568574.473327:0:7631:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788568574.473329:0:7631:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788568574.473331:0:7631:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788568574.473332:0:7631:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788568574.473333:0:7631:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788568574.473335:0:7631:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788568574.473336:0:7631:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788568574.473338:0:7631:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788568574.473339:0:7631:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788568574.473341:0:7631:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788568574.473342:0:7631:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788568574.473346:0:7631:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1788568574.473348:0:7631:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788568574.473350:0:7631:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788568574.473351:0:7631:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788568574.473352:0:7631:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788568574.473353:0:7631:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788568574.473354:0:7631:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788568574.473356:0:7631:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788568574.473357:0:7631:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788568574.473358:0:7631:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788568574.473359:0:7631:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788568574.473360:0:7631:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788568574.473386:0:7631:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788568574.473402:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:7631:1875449976210176:0@lo:253: 00000100:00100000:2.0:1788568574.473471:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568574.473580:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae242d6cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788568574.473686:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf63100 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7645:1875449976210304:0@lo:901: 00000100:00100000:0.0:1788568574.473720:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568574.473778:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae250ae4600 going to sleep for 11 seconds 00000100:00100000:3.0:1788568574.473909:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976210176 00000100:00100000:3.0:1788568574.473916:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976210176 00000100:00100000:3.0:1788568574.474061:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788568574.474070:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+14:7631:x1875449976210176:12345-0@lo:253: 20000000:01000000:3.0:1788568574.474094:0:5836:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788568574.474107:0:5836:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788568574.474654:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976210304 00000100:00100000:2.0:1788568574.474660:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976210304 00000100:00100000:2.0:1788568574.474703:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788568574.474710:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7645:x1875449976210304:12345-0@lo:901: 00000100:00080000:0.0:1788568574.474822:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788568574.475208:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7645:x1875449976210304:12345-0@lo:901: Request processed in 497us (1485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568574.475217:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788568574.479686:0:7645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae27bf63100 x1875449976210304/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788568590 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568574.479703:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf63100 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7645:1875449976210304:0@lo:901: 20000000:01000000:3.0:1788568574.497625:0:5836:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788568574.497640:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788568574.497714:0:5858:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788568574.497718:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788568574.497748:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ae252e7ae00/0x41e82f464b6a0c6e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568574.497766:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae252e7a800/0x41e82f464b6a0bbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0bb8 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568574.497776:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ae252e7ae00/0x41e82f464b6a0c6e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568574.497814:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae252e7a800/0x41e82f464b6a0bbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x41e82f464b6a0bb8 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568574.497828:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae252e7a800/0x41e82f464b6a0bbf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x41e82f464b6a0bb8 expref: 14 pid: 5834 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568574.497842:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce7800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1875449976210432:0@lo:104: 00000100:00100000:2.0:1788568574.497901:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568574.498113:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2487d30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788568574.499722:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976210432 00000100:00100000:3.0:1788568574.499747:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976210432 00000100:00100000:3.0:1788568574.499830:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788568574.499841:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:925db6b8-84bc-418c-b37a-40345c1020be+3:5858:x1875449976210432:12345-0@lo:104: 00010000:00010000:3.0:1788568574.499858:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.104@tcp lock: ffff9ae240030200/0x41e82f464b6a0bb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0bbf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568574.499960:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788568574.499966:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:925db6b8-84bc-418c-b37a-40345c1020be+3:5858:x1875449976210432:12345-0@lo:104: Request processed in 128us (2065us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568574.499974:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788568574.500056:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce7800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1875449976210432:0@lo:104: 00010000:00010000:1.0:1788568574.500080:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ae252e7ae00/0x41e82f464b6a0c6e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568574.500890:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788568574.500900:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae240030200/0x41e82f464b6a0bb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0bbf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568574.500956:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae240030200 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:3.0:1788568574.500961:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae240030200/0x41e82f464b6a0bb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x41e82f464b6a0bbf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568574.500970:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae240030200/0x41e82f464b6a0bb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x41e82f464b6a0bbf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788568574.500978:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae240030200/0x41e82f464b6a0bb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x41e82f464b6a0bbf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788568574.500983:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788568574.501031:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae240030200/0x41e82f464b6a0bb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0bbf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568574.501038:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788568574.501056:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae240030200/0x41e82f464b6a0bb8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0bbf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568574.501063:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae240030200/0x41e82f464b6a0bb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0bbf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568574.501080:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568574.501081:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568574.501083:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568574.501095:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae28170b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925db6b8-84bc-418c-b37a-40345c1020be:3307:1875449976210560:0@lo:103: 00000100:00100000:3.0:1788568574.501142:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568574.501198:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976210560 00000100:00100000:3.0:1788568574.501204:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976210560 00010000:00010000:3.0:1788568574.501224:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae252e7a800/0x41e82f464b6a0bbf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0bb8 expref: 15 pid: 5834 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568574.501258:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788568574.501266:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244618050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:925db6b8-84bc-418c-b37a-40345c1020be+15:3307:x1875449976210560:12345-0@lo:103: 00010000:00010000:3.0:1788568574.501277:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568574.501282:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae252e7a800/0x41e82f464b6a0bbf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0bb8 expref: 15 pid: 5834 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568574.501293:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae252e7a800/0x41e82f464b6a0bbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x41e82f464b6a0bb8 expref: 15 pid: 5834 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568574.501306:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae252e7a800/0x41e82f464b6a0bbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x41e82f464b6a0bb8 expref: 15 pid: 5834 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568574.501318:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ae252e7ae00/0x41e82f464b6a0c6e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568574.501326:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae252e7ae00/0x41e82f464b6a0c6e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788568574.501340:0:6705:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003713446s 00010000:00010000:3.0:1788568574.501345:0:6705:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae252e7ae00/0x41e82f464b6a0c6e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568574.501352:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae252e7ae00/0x41e82f464b6a0c6e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568574.501358:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ae252e7ae00/0x41e82f464b6a0c6e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568574.501364:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ae252e7ae00/0x41e82f464b6a0c6e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568574.501375:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7ae00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788568574.501379:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ae252e7ae00/0x41e82f464b6a0c6e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568574.501387:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ae252e7ae00/0x41e82f464b6a0c6e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568574.501400:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ae252e7ae00/0x41e82f464b6a0c6e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568574.501410:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788568574.501439:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244618050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:925db6b8-84bc-418c-b37a-40345c1020be+14:3307:x1875449976210560:12345-0@lo:103: Request processed in 174us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568574.501446:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788568574.501513:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae28170b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925db6b8-84bc-418c-b37a-40345c1020be:3307:1875449976210560:0@lo:103: 00010000:00010000:3.0:1788568574.501532:0:5858:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ae252e7ae00/0x41e82f464b6a0c6e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568574.501542:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ae252e7ae00/0x41e82f464b6a0c6e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568574.501548:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae252e7ae00/0x41e82f464b6a0c6e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568574.507019:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+13:7631:x1875449976210176:12345-0@lo:253: Request processed in 32932us (33529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568574.507032:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788568574.507132:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:925db6b8-84bc-418c-b37a-40345c1020be:7631:1875449976210176:0@lo:253: 10000000:01000000:2.0:1788568574.507147:0:7631:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788568574.507151:0:7631:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788568574.507153:0:7631:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788568574.507154:0:7631:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788568574.507155:0:7631:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788568574.507157:0:7631:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788568574.507158:0:7631:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788568574.507159:0:7631:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788568574.507160:0:7631:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788568574.507161:0:7631:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788568574.507163:0:7631:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788568574.507165:0:7631:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788568574.507180:0:7631:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788568574.512020:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788568574.512232:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788568574.512456:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788568574.512638:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788568574.512906:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788568574.513258:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788568574.514296:0:7631:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788568574.708756:0:7631:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788568574.708763:0:7631:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788568574.708798:0:7631:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788568574.708854:0:7631:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.104@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788568574.708868:0:7631:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788568574.708892:0:7631:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788568575.159197:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568575.486575:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788568575.486600:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae251dc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976210688:0@lo:13: 00000100:00100000:1.0:1788568575.486664:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568575.486719:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976210688 00000100:00100000:1.0:1788568575.486725:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976210688 00000100:00100000:1.0:1788568575.486765:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788568575.486774:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976210688:12345-0@lo:13: 00002000:00000024:1.0:1788568575.486807:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788568575.486844:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976210688:12345-0@lo:13: Request processed in 71us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568575.486850:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788568575.486889:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae251dc4000 x1875449976210688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568591 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568575.486905:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae251dc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976210688:0@lo:13: 00010000:00010000:3.0:1788568576.183449:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568577.207321:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568578.232512:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568579.258471:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568579.578677:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925db6b8-84bc-418c-b37a-40345c1020be:3309:1875449976210816:0@lo:400: 00000100:00100000:2.0:1788568579.578759:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568579.578802:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875449976211328:0@lo:400: 00000100:00100000:2.0:1788568579.578828:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568579.578853:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788568579.578859:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976211200:0@lo:400: 00000100:00100000:2.0:1788568579.578883:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568579.578912:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976210944:0@lo:400: 00000100:00100000:2.0:1788568579.578973:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568579.579012:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788568579.579018:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875449976211072:0@lo:400: 00000100:00100000:2.0:1788568579.579046:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568579.579078:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976210816 00000100:00100000:2.0:1788568579.579085:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976210816 00000100:00100000:2.0:1788568579.579134:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788568579.579142:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+13:3309:x1875449976210816:12345-0@lo:400: 00000100:00100000:2.0:1788568579.579187:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+13:3309:x1875449976210816:12345-0@lo:400: Request processed in 46us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568579.579193:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788568579.579225:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976211328 00000100:00100000:2.0:1788568579.579229:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976211328 00000100:00100000:2.0:1788568579.579261:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976210944 00000100:00100000:2.0:1788568579.579264:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976210944 00000100:00100000:2.0:1788568579.579275:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976211072 00000100:00100000:2.0:1788568579.579277:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976211072 00000100:00100000:2.0:1788568579.579289:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788568579.579295:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cce5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875449976211328:12345-0@lo:400: 00000100:00100000:2.0:1788568579.579328:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cce5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875449976211328:12345-0@lo:400: Request processed in 33us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568579.579334:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788568579.579346:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788568579.579352:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae1419bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976210944:12345-0@lo:400: 00000100:00100000:2.0:1788568579.579382:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae1419bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976210944:12345-0@lo:400: Request processed in 30us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568579.579387:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788568579.579399:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788568579.579405:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae1419bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875449976211072:12345-0@lo:400: 00000100:00100000:2.0:1788568579.579430:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae1419bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875449976211072:12345-0@lo:400: Request processed in 25us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568579.579443:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788568579.579463:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976211200 00000100:00100000:2.0:1788568579.579467:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976211200 00000100:00100000:2.0:1788568579.579494:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788568579.579500:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cce7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976211200:12345-0@lo:400: 00000100:00100000:2.0:1788568579.579529:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cce7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976211200:12345-0@lo:400: Request processed in 30us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568579.579535:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788568579.579557:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788568579.579561:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788568579.579590:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae27cce7480 x1875449976211072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568579.579603:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875449976211072:0@lo:400: 00010000:00080000:2.0:1788568579.579612:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae27cce6d80 x1875449976210944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568579.579620:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976210944:0@lo:400: 00010000:00080000:2.0:1788568579.579650:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae27cce4700 x1875449976211200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568579.579659:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976211200:0@lo:400: 00000100:00100000:2.0:1788568579.579667:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925db6b8-84bc-418c-b37a-40345c1020be:3309:1875449976210816:0@lo:400: 00010000:00080000:2.0:1788568579.579676:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae27cce5180 x1875449976211328/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568579.579683:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875449976211328:0@lo:400: 10000000:01000000:1.0:1788568579.580703:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788568579.580721:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ae27bf74800 from 30 10000000:01000000:1.0:1788568579.580725:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788568579.580762:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae282045a00/0x41e82f464b6a0c75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568579.580772:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae282045a00/0x41e82f464b6a0c75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568579.580782:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae282045a00/0x41e82f464b6a0c75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568579.580808:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae251dc4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976211456:0@lo:101: 00000100:00100000:1.0:1788568579.580856:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568579.580890:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976211456 00000100:00100000:1.0:1788568579.580896:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976211456 00000100:00100000:1.0:1788568579.580944:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788568579.580952:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+13:5838:x1875449976211456:12345-0@lo:101: 00010000:00010000:1.0:1788568579.580962:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568579.580973:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae282045e00/0x41e82f464b6a0c7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0c75 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568579.581004:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae282045e00/0x41e82f464b6a0c7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0c75 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568579.581014:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae282045e00/0x41e82f464b6a0c7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0c75 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568579.581022:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae282045e00, rc 0) 00000100:00100000:1.0:1788568579.581049:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+14:5838:x1875449976211456:12345-0@lo:101: Request processed in 99us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568579.581055:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788568579.581088:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae142aba000 going to sleep for 11 seconds 00000100:00100000:1.0:1788568579.581106:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae251dc4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976211456:0@lo:101: 00010000:00010000:1.0:1788568579.581119:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae282045a00/0x41e82f464b6a0c75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0c7c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568579.581127:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae282045a00/0x41e82f464b6a0c75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0c7c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568579.581183:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae251dc4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976211584:0@lo:501: 00000100:00100000:1.0:1788568579.581206:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568579.581223:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976211584 00000100:00100000:1.0:1788568579.581227:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976211584 00000100:00100000:1.0:1788568579.581244:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788568579.581250:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+14:5838:x1875449976211584:12345-0@lo:501: 00000100:00100000:1.0:1788568579.581566:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+14:5838:x1875449976211584:12345-0@lo:501: Request processed in 315us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568579.581573:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788568579.581598:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae142aba000 going to sleep for 11 seconds 00000100:00100000:1.0:1788568579.581609:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae251dc4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976211584:0@lo:501: 00000100:00100000:1.0:1788568579.581634:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae251dc4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976211712:0@lo:503: 00000100:00100000:1.0:1788568579.581671:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568579.581689:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976211712 00000100:00100000:1.0:1788568579.581692:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976211712 00000100:00100000:1.0:1788568579.581712:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788568579.581718:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+14:5838:x1875449976211712:12345-0@lo:503: 00000100:00100000:1.0:1788568579.582004:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+14:5838:x1875449976211712:12345-0@lo:503: Request processed in 285us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568579.582010:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788568579.582040:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2487eba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788568579.582052:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae251dc4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976211712:0@lo:503: 00000100:00100000:2.0:1788568579.584329:0:7883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae1419bc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:7883:1875449976211840:0@lo:502: 00000100:00100000:2.0:1788568579.584410:0:7883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568579.584442:0:7883:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2487d3600 going to sleep for 11 seconds 00000100:00100000:3.0:1788568579.584491:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976211840 00000100:00100000:3.0:1788568579.584499:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976211840 00000100:00100000:3.0:1788568579.584545:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788568579.584554:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+14:7883:x1875449976211840:12345-0@lo:502: 00000100:00100000:3.0:1788568579.584860:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+14:7883:x1875449976211840:12345-0@lo:502: Request processed in 306us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568579.584868:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788568579.585068:0:7883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae1419bc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:7883:1875449976211840:0@lo:502: 00000100:00100000:2.0:1788568579.585115:0:7883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae1419bc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:7883:1875449976211968:0@lo:502: 00000100:00100000:2.0:1788568579.585148:0:7883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568579.585173:0:7883:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2487d3600 going to sleep for 11 seconds 00000100:00100000:3.0:1788568579.585212:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976211968 00000100:00100000:3.0:1788568579.585218:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976211968 00000100:00100000:3.0:1788568579.585246:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788568579.585254:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+14:7883:x1875449976211968:12345-0@lo:502: 00000100:00100000:3.0:1788568579.585376:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+14:7883:x1875449976211968:12345-0@lo:502: Request processed in 122us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568579.585383:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788568579.587536:0:7883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae1419bc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:7883:1875449976211968:0@lo:502: 00000040:00080000:2.0:1788568579.587580:0:7883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788568579.588063:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788568579.588083:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788568579.588093:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae282045a00/0x41e82f464b6a0c75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0c7c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568579.588104:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae282045a00/0x41e82f464b6a0c75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0c7c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788568579.588152:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788568579.588155:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1788568579.588158:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788568579.588188:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae2429df200/0x41e82f464b6a0c83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568579.588195:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae2429df200/0x41e82f464b6a0c83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568579.588205:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae2429df200/0x41e82f464b6a0c83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568579.588223:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae28170b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976212096:0@lo:101: 00000100:00100000:3.0:1788568579.588282:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568579.588315:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976212096 00000100:00100000:3.0:1788568579.588321:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976212096 00000100:00100000:3.0:1788568579.588355:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788568579.588362:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae250449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+14:5838:x1875449976212096:12345-0@lo:101: 00010000:00010000:3.0:1788568579.588373:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568579.588385:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae2429df400/0x41e82f464b6a0c8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0c83 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568579.588406:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae2429df400/0x41e82f464b6a0c8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0c83 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568579.588415:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae2429df400/0x41e82f464b6a0c8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0c83 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568579.588423:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429df400, rc 0) 00000100:00100000:3.0:1788568579.588455:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae250449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+15:5838:x1875449976212096:12345-0@lo:101: Request processed in 93us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568579.588462:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788568579.588498:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27b563f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788568579.588511:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae28170b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976212096:0@lo:101: 00010000:00010000:3.0:1788568579.588527:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae2429df200/0x41e82f464b6a0c83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0c8a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568579.588535:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae2429df200/0x41e82f464b6a0c83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0c8a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568579.588571:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae28170b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976212224:0@lo:501: 00000100:00100000:3.0:1788568579.588591:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568579.588607:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976212224 00000100:00100000:3.0:1788568579.588610:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976212224 00000100:00100000:3.0:1788568579.588626:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788568579.588631:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae250449450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+15:5838:x1875449976212224:12345-0@lo:501: 00000100:00100000:3.0:1788568579.588816:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae250449450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+15:5838:x1875449976212224:12345-0@lo:501: Request processed in 184us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568579.588823:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788568579.588840:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27b563f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788568579.588849:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae28170b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976212224:0@lo:501: 00000100:00100000:3.0:1788568579.588870:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae28170b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976212352:0@lo:503: 00000100:00100000:3.0:1788568579.588902:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568579.588921:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976212352 00000100:00100000:3.0:1788568579.588945:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976212352 00000100:00100000:3.0:1788568579.588967:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788568579.588995:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+15:5838:x1875449976212352:12345-0@lo:503: 00000100:00100000:3.0:1788568579.589256:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+15:5838:x1875449976212352:12345-0@lo:503: Request processed in 276us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568579.589263:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788568579.589293:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27b563f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788568579.589306:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae28170b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976212352:0@lo:503: 00000100:00100000:3.0:1788568579.592293:0:7884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae28170b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:7884:1875449976212480:0@lo:502: 00000100:00100000:3.0:1788568579.592377:0:7884:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568579.592420:0:7884:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27b5630c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788568579.592487:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976212480 00000100:00100000:2.0:1788568579.592494:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976212480 00000100:00100000:2.0:1788568579.592536:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788568579.592544:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+15:7884:x1875449976212480:12345-0@lo:502: 00000100:00100000:2.0:1788568579.593124:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+15:7884:x1875449976212480:12345-0@lo:502: Request processed in 578us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568579.593133:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788568579.593407:0:7884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae28170b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:7884:1875449976212480:0@lo:502: 00000020:01000000:1.0:1788568579.593438:0:7884:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788568579.593452:0:7884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568579.593454:0:7884:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788568579.593460:0:7884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788568579.593462:0:7884:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788568579.593486:0:7884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae251dc4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:7884:1875449976212608:0@lo:502: 00000100:00100000:1.0:1788568579.593526:0:7884:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568579.593557:0:7884:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae26f598540 going to sleep for 11 seconds 00000100:00100000:3.0:1788568579.593601:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976212608 00000100:00100000:3.0:1788568579.593606:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976212608 00000100:00100000:3.0:1788568579.593642:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788568579.593648:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+15:7884:x1875449976212608:12345-0@lo:502: 00000100:00100000:3.0:1788568579.594855:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+15:7884:x1875449976212608:12345-0@lo:502: Request processed in 1201us (1322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568579.594865:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788568579.611307:0:7884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae251dc4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:7884:1875449976212608:0@lo:502: 00000020:01000000:1.0:1788568579.611374:0:7884:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788568579.611382:0:7884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568579.611384:0:7884:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788568579.611389:0:7884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1788568579.611452:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1788568579.611467:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788568579.611477:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae2429df200/0x41e82f464b6a0c83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0c8a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568579.611487:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae2429df200/0x41e82f464b6a0c83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0c8a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788568579.611497:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788568579.611499:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ae26b352000 from 30 10000000:01000000:1.0:1788568579.611502:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788568579.611529:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae282045000/0x41e82f464b6a0c91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568579.611537:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae282045000/0x41e82f464b6a0c91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568579.611545:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae282045000/0x41e82f464b6a0c91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568579.611572:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae251dc4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976212736:0@lo:101: 00000100:00100000:1.0:1788568579.611627:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568579.611668:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2487eba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788568579.616571:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976212736 00000100:00100000:3.0:1788568579.616586:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976212736 00000100:00100000:3.0:1788568579.616648:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788568579.616659:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae250448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+15:5838:x1875449976212736:12345-0@lo:101: 00010000:00010000:3.0:1788568579.616676:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568579.616695:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae2429df600/0x41e82f464b6a0c98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0c91 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568579.616735:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae2429df600/0x41e82f464b6a0c98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0c91 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568579.616762:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae2429df600/0x41e82f464b6a0c98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0c91 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568579.616770:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429df600, rc 0) 00000100:00100000:3.0:1788568579.616842:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae250448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+16:5838:x1875449976212736:12345-0@lo:101: Request processed in 186us (5215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568579.616848:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788568579.616905:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae251dc4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976212736:0@lo:101: 00010000:00010000:3.0:1788568579.616922:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae282045000/0x41e82f464b6a0c91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0c98 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568579.616951:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae282045000/0x41e82f464b6a0c91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0c98 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568579.617030:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae281708e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976212864:0@lo:501: 00000100:00100000:3.0:1788568579.617060:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568579.617088:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27b5630c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788568579.621844:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976212864 00000100:00100000:2.0:1788568579.621857:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976212864 00000100:00100000:2.0:1788568579.621906:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788568579.621915:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae250448850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+16:5838:x1875449976212864:12345-0@lo:501: 00000100:00100000:2.0:1788568579.622527:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae250448850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+16:5838:x1875449976212864:12345-0@lo:501: Request processed in 612us (5464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568579.622536:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788568579.629033:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae281708e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976212864:0@lo:501: 00000100:00100000:1.0:1788568579.629102:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae251dc5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976212992:0@lo:503: 00000100:00100000:1.0:1788568579.629176:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568579.629216:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2487eba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788568579.629426:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976212992 00000100:00100000:3.0:1788568579.629434:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976212992 00000100:00100000:3.0:1788568579.629494:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788568579.629505:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae250449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+16:5838:x1875449976212992:12345-0@lo:503: 00000100:00100000:3.0:1788568579.629733:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae250449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+16:5838:x1875449976212992:12345-0@lo:503: Request processed in 229us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568579.629740:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788568579.629788:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae251dc5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976212992:0@lo:503: 00000100:00100000:3.0:1788568579.629997:0:7889:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae28170a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:7889:1875449976213120:0@lo:502: 00000100:00100000:3.0:1788568579.630480:0:7889:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568579.630504:0:7889:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2487eba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788568579.631647:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976213120 00000100:00100000:1.0:1788568579.631662:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976213120 00000100:00100000:1.0:1788568579.631733:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788568579.631744:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+16:7889:x1875449976213120:12345-0@lo:502: 00000100:00100000:1.0:1788568579.632213:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+16:7889:x1875449976213120:12345-0@lo:502: Request processed in 470us (1731us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568579.632220:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788568579.632339:0:7889:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae28170a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:7889:1875449976213120:0@lo:502: 00000100:00100000:3.0:1788568579.632398:0:7889:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae28170a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:7889:1875449976213248:0@lo:502: 00000100:00100000:3.0:1788568579.632440:0:7889:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568579.632466:0:7889:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae250ae4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788568579.633155:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976213248 00000100:00100000:0.0:1788568579.633163:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976213248 00000100:00100000:0.0:1788568579.633197:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788568579.633204:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+16:7889:x1875449976213248:12345-0@lo:502: 00000100:00100000:0.0:1788568579.633407:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+16:7889:x1875449976213248:12345-0@lo:502: Request processed in 203us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568579.633420:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788568579.634085:0:7889:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae28170a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:7889:1875449976213248:0@lo:502: 00000040:00080000:3.0:1788568579.634118:0:7889:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788568579.635155:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788568579.635179:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788568579.635190:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae282045000/0x41e82f464b6a0c91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0c98 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568579.635202:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae282045000/0x41e82f464b6a0c91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0c98 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568579.635212:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788568579.635214:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ae26b352000 from 5 10000000:01000000:0.0:1788568579.635217:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788568579.635257:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae240030800/0x41e82f464b6a0c9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568579.635266:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae240030800/0x41e82f464b6a0c9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568579.635275:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae240030800/0x41e82f464b6a0c9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568579.635294:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf63100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976213376:0@lo:101: 00000100:00100000:0.0:1788568579.635350:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568579.635390:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae141c42b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788568579.635549:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976213376 00000100:00100000:1.0:1788568579.635556:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976213376 00000100:00100000:1.0:1788568579.635597:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788568579.635606:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae250449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+16:5838:x1875449976213376:12345-0@lo:101: 00010000:00010000:1.0:1788568579.635617:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568579.635629:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae282045200/0x41e82f464b6a0ca6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0c9f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568579.635649:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae282045200/0x41e82f464b6a0ca6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0c9f expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568579.635658:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae282045200/0x41e82f464b6a0ca6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0c9f expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568579.635680:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae282045200, rc 0) 00000100:00100000:1.0:1788568579.635732:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae250449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+17:5838:x1875449976213376:12345-0@lo:101: Request processed in 126us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568579.635737:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788568579.635847:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf63100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976213376:0@lo:101: 00010000:00010000:0.0:1788568579.635859:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae240030800/0x41e82f464b6a0c9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0ca6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568579.635868:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae240030800/0x41e82f464b6a0c9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0ca6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568579.635917:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf63100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976213504:0@lo:256: 00000100:00100000:0.0:1788568579.635970:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568579.636004:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae141c42b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788568579.636136:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976213504 00000100:00100000:3.0:1788568579.636141:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976213504 00000100:00100000:3.0:1788568579.636172:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788568579.636179:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+17:5838:x1875449976213504:12345-0@lo:256: 20000000:01000000:3.0:1788568579.636192:0:5835:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788568579.636209:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788568579.636212:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1788568579.636290:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+17:5838:x1875449976213504:12345-0@lo:256: Request processed in 111us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568579.636297:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788568579.636813:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf63100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976213504:0@lo:256: 10000000:01000000:0.0:1788568579.636855:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788568579.636862:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae240030800/0x41e82f464b6a0c9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0ca6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568579.636869:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae240030800/0x41e82f464b6a0c9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0ca6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568579.636876:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788568579.636878:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1788568579.636881:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788568579.636900:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae240030200/0x41e82f464b6a0cad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568579.636907:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae240030200/0x41e82f464b6a0cad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568579.636914:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae240030200/0x41e82f464b6a0cad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568579.636962:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf63100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976213632:0@lo:101: 00000100:00100000:0.0:1788568579.637078:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568579.637106:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae141c42b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788568579.637208:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976213632 00000100:00100000:3.0:1788568579.637213:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976213632 00000100:00100000:3.0:1788568579.637245:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788568579.637253:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae250448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+17:5838:x1875449976213632:12345-0@lo:101: 00010000:00010000:3.0:1788568579.637262:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568579.637274:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae2429dfa00/0x41e82f464b6a0cb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0cad expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568579.637291:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae2429dfa00/0x41e82f464b6a0cb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0cad expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568579.637309:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae2429dfa00/0x41e82f464b6a0cb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0cad expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568579.637316:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429dfa00, rc 0) 00000100:00100000:3.0:1788568579.637349:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae250448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+18:5838:x1875449976213632:12345-0@lo:101: Request processed in 96us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568579.637355:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788568579.637443:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf63100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976213632:0@lo:101: 00010000:00010000:0.0:1788568579.637460:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae240030200/0x41e82f464b6a0cad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0cb4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568579.637467:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae240030200/0x41e82f464b6a0cad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0cb4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568579.637512:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf63100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976213760:0@lo:501: 00000100:00100000:0.0:1788568579.637535:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568579.637556:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae141c42b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788568579.637798:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976213760 00000100:00100000:3.0:1788568579.637803:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976213760 00000100:00100000:3.0:1788568579.637836:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788568579.637842:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+18:5838:x1875449976213760:12345-0@lo:501: 00000100:00100000:3.0:1788568579.639152:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+18:5838:x1875449976213760:12345-0@lo:501: Request processed in 1304us (1609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568579.639162:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788568579.642045:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf63100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976213760:0@lo:501: 00000100:00100000:1.0:1788568579.642105:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae251dc7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976213888:0@lo:503: 00000100:00100000:1.0:1788568579.642175:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568579.642206:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae142aba000 going to sleep for 11 seconds 00000100:00100000:3.0:1788568579.643306:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976213888 00000100:00100000:3.0:1788568579.643323:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976213888 00000100:00100000:3.0:1788568579.643379:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788568579.643391:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae250448050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+18:5838:x1875449976213888:12345-0@lo:503: 00000100:00100000:3.0:1788568579.643790:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae250448050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+18:5838:x1875449976213888:12345-0@lo:503: Request processed in 400us (1613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568579.643798:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788568579.643857:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae251dc7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976213888:0@lo:503: 00000100:00100000:3.0:1788568579.644217:0:7890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae28170a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:7890:1875449976214016:0@lo:502: 00000100:00100000:3.0:1788568579.644259:0:7890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568579.644282:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976214016 00000100:00100000:3.0:1788568579.644292:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976214016 00000100:00100000:3.0:1788568579.644318:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788568579.644325:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+18:7890:x1875449976214016:12345-0@lo:502: 00000100:00100000:3.0:1788568579.644523:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+18:7890:x1875449976214016:12345-0@lo:502: Request processed in 198us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568579.644530:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788568579.644569:0:7890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae250ae4180 going to sleep for 11 seconds 00000100:00100000:3.0:1788568579.644583:0:7890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae28170a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:7890:1875449976214016:0@lo:502: 00000020:01000000:3.0:1788568579.644606:0:7890:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788568579.644614:0:7890:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788568579.644620:0:7890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788568579.644622:0:7890:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788568579.644625:0:7890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788568579.644629:0:7890:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.104@tcp to nid 0x20000c0a8ce68 (192.168.206.104@tcp) 00000020:01000000:3.0:1788568579.644648:0:7890:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788568579.644650:0:7890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788568579.644662:0:7890:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9ae26fb7cd40) 00000020:00000080:3.0:1788568579.644681:0:7890:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1788568579.644686:0:7890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788568579.647577:0:7890:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788568579.647586:0:7890:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788568579.647596:0:7890:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x41e82f464b6a0cc2 00010000:00080000:3.0:1788568579.647639:0:7890:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae27fd8f000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.104@tcp at head 00010000:00010000:3.0:1788568579.647877:0:7890:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1788568579.651351:0:7890:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788568579.651369:0:7890:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788568579.654391:0:7890:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788568579.654698:0:7890:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788568579.654766:0:7890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1788568579.654826:0:7890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788568579.663862:0:7893:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788568579.663872:0:7893:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788568579.669216:0:7890:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788568579.669231:0:7890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788568579.669266:0:7890:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788568579.669285:0:7890:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x41e82f464b6a0cc9 00000100:00080000:0.0:1788568579.669295:0:7890:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788568579.669300:0:7890:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ae27fd8f000 using connection 192.168.206.104@tcp/0@lo 00000100:00100000:0.0:1788568579.669331:0:7890:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae27bf62a00 x1875449976214144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788568579.669352:0:7890:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788568579.669396:0:7890:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788568579.669399:0:7890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788568579.669401:0:7890:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788568579.669403:0:7890:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788568579.669407:0:7890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788568579.669408:0:7890:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788568579.669410:0:7890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788568579.669412:0:7890:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788568579.669436:0:7890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf60700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:7890:1875449976214272:0@lo:502: 00000100:00100000:0.0:1788568579.669511:0:7890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568579.669542:0:7890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae141c42180 going to sleep for 11 seconds 00000100:00100000:3.0:1788568579.669686:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875449976214144:0@lo:8: 00000100:00100000:3.0:1788568579.669738:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568579.669783:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976214272 00000100:00100000:3.0:1788568579.669789:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976214272 00000100:00100000:3.0:1788568579.669827:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788568579.669836:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+18:7890:x1875449976214272:12345-0@lo:502: 00000100:00100000:0.0:1788568579.670167:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976214144 00000100:00100000:0.0:1788568579.670173:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976214144 00000100:00100000:0.0:1788568579.670198:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788568579.670203:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae28170a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1875449976214144:12345-0@lo:8: 00010000:00080000:0.0:1788568579.670227:0:6690:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:0.0:1788568579.670251:0:6690:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x41e82f464b6a0cd0 00002000:00100000:0.0:1788568579.670264:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9ae27ccb4000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788568579.670269:0:6690:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1788568579.670272:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1788568579.670387:0:6690:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788568579.670534:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788568579.670557:0:6690:0:(import.c:65:import_set_state_nolock()) ffff9ae26f6ff000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788568579.670615:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae28170a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1875449976214144:12345-0@lo:8: Request processed in 410us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568579.670622:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788568579.670869:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+18:7890:x1875449976214272:12345-0@lo:502: Request processed in 1034us (1358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568579.670877:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:3.0:1788568579.670965:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae27bf62a00 x1875449976214144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788568589 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568579.670975:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788568579.670994:0:3305:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788568579.671002:0:3305:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788568579.671083:0:3305:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788568579.671086:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ae27fd8f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788568579.671094:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788568579.671099:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875449976214144:0@lo:8: 00000100:00100000:0.0:1788568579.671364:0:7890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf60700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:7890:1875449976214272:0@lo:502: 00000020:01000000:0.0:1788568579.671391:0:7890:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788568579.671397:0:7890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788568579.671399:0:7890:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788568579.671404:0:7890:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000004:00080000:0.0:1788568579.671533:0:7893:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788568579.671611:0:7893:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 214079683419ns, next at 0ns, rc = 0 00000020:01000000:3.0:1788568579.671673:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1788568579.671695:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788568579.671705:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae240030200/0x41e82f464b6a0cad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0cb4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568579.671796:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae240030200/0x41e82f464b6a0cad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0cb4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788568579.671807:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788568579.671820:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ae26b2dcd40 from 1 10000000:01000000:3.0:1788568579.671824:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788568579.671854:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae2429df000/0x41e82f464b6a0cd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568579.671861:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae2429df000/0x41e82f464b6a0cd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568579.671870:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae2429df000/0x41e82f464b6a0cd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568579.671891:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae28170a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976214400:0@lo:101: 00000100:00100000:3.0:1788568579.671990:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568579.672452:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae1419bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976214528:0@lo:400: 00000100:00100000:2.0:1788568579.672485:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568579.672513:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788568579.672518:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae1419bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875449976214656:0@lo:400: 00000100:00100000:2.0:1788568579.672549:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568579.672577:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae1419bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976214784:0@lo:400: 00000100:00100000:2.0:1788568579.672600:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568579.672617:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788568579.672622:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae1419bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875449976214912:0@lo:400: 00000100:00100000:2.0:1788568579.672640:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568579.673140:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976214400 00000100:00100000:0.0:1788568579.673148:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976214400 00000100:00100000:0.0:1788568579.673191:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788568579.673200:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+18:5838:x1875449976214400:12345-0@lo:101: 00010000:00010000:0.0:1788568579.673221:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568579.673237:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae240031c00/0x41e82f464b6a0cde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0cd7 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568579.673262:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae240031c00/0x41e82f464b6a0cde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0cd7 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568579.673272:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae240031c00/0x41e82f464b6a0cde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0cd7 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568579.673280:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae240031c00, rc 0) 00000100:00100000:0.0:1788568579.673319:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+19:5838:x1875449976214400:12345-0@lo:101: Request processed in 120us (1339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568579.673325:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788568579.673513:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae142aba000 going to sleep for 11 seconds 00000100:00100000:3.0:1788568579.673534:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae28170a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976214400:0@lo:101: 00010000:00010000:3.0:1788568579.673549:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae2429df000/0x41e82f464b6a0cd7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0cde expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568579.673558:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae2429df000/0x41e82f464b6a0cd7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0cde expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568579.673614:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae28170a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976215040:0@lo:501: 00000100:00100000:3.0:1788568579.673641:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568579.673663:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae142aba000 going to sleep for 11 seconds 00000100:00100000:3.0:1788568579.674831:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976214528 00000100:00100000:3.0:1788568579.674842:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976214528 00000100:00100000:3.0:1788568579.674886:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976214656 00000100:00100000:3.0:1788568579.674889:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976214656 00000100:00100000:3.0:1788568579.674902:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976214912 00000100:00100000:3.0:1788568579.674905:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976214912 00000100:00100000:3.0:1788568579.674961:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788568579.674971:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae1419bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976214528:12345-0@lo:400: 00000100:00100000:0.0:1788568579.675126:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976215040 00000100:00100000:0.0:1788568579.675131:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976215040 00000100:00100000:0.0:1788568579.675161:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788568579.675168:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+19:5838:x1875449976215040:12345-0@lo:501: 00000100:00100000:0.0:1788568579.675397:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+19:5838:x1875449976215040:12345-0@lo:501: Request processed in 230us (1754us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788568579.675405:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788568579.675820:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae1419bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976214528:12345-0@lo:400: Request processed in 849us (3331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568579.675828:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788568579.675847:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788568579.675856:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae1419bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875449976214656:12345-0@lo:400: 00000100:00100000:3.0:1788568579.675889:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae1419bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875449976214656:12345-0@lo:400: Request processed in 35us (3338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568579.675894:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788568579.675905:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788568579.675911:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae1419bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875449976214912:12345-0@lo:400: 00000100:00100000:3.0:1788568579.675963:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae1419bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875449976214912:12345-0@lo:400: Request processed in 52us (3321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568579.675968:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788568579.676186:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976214784 00000100:00100000:2.0:1788568579.676192:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976214784 00000100:00100000:2.0:1788568579.676223:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788568579.676229:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae1419be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976214784:12345-0@lo:400: 00000100:00100000:2.0:1788568579.676266:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae1419be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976214784:12345-0@lo:400: Request processed in 37us (3663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568579.676272:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788568579.676824:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae28170a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976215040:0@lo:501: 10000000:01000000:3.0:1788568579.676869:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788568579.676879:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae2429df000/0x41e82f464b6a0cd7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0cde expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568579.676889:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae2429df000/0x41e82f464b6a0cd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0cde expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1788568579.677824:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae1419bed80 x1875449976214656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568579.677839:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae1419bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875449976214656:0@lo:400: 00010000:00080000:3.0:1788568579.677864:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae1419bc000 x1875449976214528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568579.677873:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae1419bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976214528:0@lo:400: 00010000:00080000:2.0:1788568579.679283:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae1419bc380 x1875449976214912/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568579.679297:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae1419bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875449976214912:0@lo:400: 00010000:00080000:2.0:1788568579.679309:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae1419bca80 x1875449976214784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568579.679316:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae1419bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976214784:0@lo:400: 00000100:00100000:3.0:1788568579.741599:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae28170a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976215168:0@lo:13: 00000100:00100000:3.0:1788568579.741668:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568579.741810:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976215168 00000100:00100000:1.0:1788568579.741819:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976215168 00000100:00100000:1.0:1788568579.741887:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788568579.741896:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281708700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875449976215168:12345-0@lo:13: 00002000:00000024:1.0:1788568579.741949:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1788568579.742004:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281708700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875449976215168:12345-0@lo:13: Request processed in 109us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568579.742010:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788568579.742040:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1788568579.742102:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00080000:3.0:1788568579.743013:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae28170a300 x1875449976215168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568595 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568579.743039:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae28170a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976215168:0@lo:13: 00000004:00080000:3.0:1788568579.743078:0:7895:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788568579.743110:0:7895:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae28170a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7895:1875449976215296:0@lo:7: 00000100:00100000:3.0:1788568579.743156:0:7895:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568579.743237:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976215296 00000100:00100000:1.0:1788568579.743243:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976215296 00000100:00100000:1.0:1788568579.743282:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788568579.743291:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281708e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7895:x1875449976215296:12345-0@lo:7: 00000100:00100000:3.0:1788568579.752787:0:7895:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27906ca80 going to sleep for 11 seconds 00002000:00080000:1.0:1788568579.755321:0:6688:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1788568579.755329:0:6688:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788568579.755406:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281708e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7895:x1875449976215296:12345-0@lo:7: Request processed in 12112us (12245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568579.755415:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788568579.756880:0:7895:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae28170a300 x1875449976215296/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788568595 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568579.756897:0:7895:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae28170a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7895:1875449976215296:0@lo:7: 00000004:00080000:3.0:1788568579.756912:0:7895:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788568579.757064:0:7895:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae28170a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7895:1875449976215424:0@lo:5: 00000100:00100000:3.0:1788568579.757115:0:7895:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568579.757165:0:7895:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27906ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788568579.757683:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976215424 00000100:00100000:2.0:1788568579.757692:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976215424 00000100:00100000:2.0:1788568579.757755:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788568579.757764:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae28170b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7895:x1875449976215424:12345-0@lo:5: 00002000:00080000:2.0:1788568579.757788:0:6690:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788568579.757792:0:6690:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788568579.758158:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae28170b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7895:x1875449976215424:12345-0@lo:5: Request processed in 394us (1041us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788568579.758178:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788568579.758346:0:7895:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae28170a300 x1875449976215424/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788568595 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568579.758362:0:7895:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae28170a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7895:1875449976215424:0@lo:5: 00000004:00080000:3.0:1788568579.758373:0:7895:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788568579.758427:0:7895:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c33100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7895:1875449976215552:0@lo:700: 00000100:00100000:3.0:1788568579.758458:0:7895:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568579.758484:0:7895:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27906ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788568579.758537:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976215552 00000100:00100000:2.0:1788568579.758541:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976215552 00000100:00100000:2.0:1788568579.758579:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788568579.758585:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7895:x1875449976215552:12345-0@lo:700: 00000100:00100000:2.0:1788568579.758612:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae1419bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6697:1875449976215680:0@lo:700: 00000100:00100000:2.0:1788568579.758637:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568579.758654:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2487d3540 going to sleep for 11 seconds 00000100:00100000:1.0:1788568579.758719:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976215680 00000100:00100000:1.0:1788568579.758723:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976215680 00000100:00100000:1.0:1788568579.758755:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788568579.758763:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae1419bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6697:x1875449976215680:12345-0@lo:700: 40000000:02000000:1.0:1788568579.869923:0:5849:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1788568579.887165:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae1419bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6697:x1875449976215680:12345-0@lo:700: Request processed in 128394us (128517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568579.887186:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788568579.889541:0:6697:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae1419bca80 x1875449976215680/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788568595 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568579.889560:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae1419bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6697:1875449976215680:0@lo:700: 40000000:02000000:2.0:1788568579.889573:0:6697:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:2.0:1788568579.993587:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7895:x1875449976215552:12345-0@lo:700: Request processed in 234990us (235116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568579.993602:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788568579.993694:0:7895:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae141c33100 x1875449976215552/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788568595 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568579.993720:0:7895:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c33100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7895:1875449976215552:0@lo:700: 00000001:00100000:3.0:1788568579.996609:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788568579.996643:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000004:02000040:1.0:1788568580.093195:0:7895:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1788568580.097490:0:7895:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae251dc6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7895:1875449976215808:0@lo:5: 00000100:00100000:1.0:1788568580.097558:0:7895:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568580.097612:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976215808 00000100:00100000:1.0:1788568580.097619:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976215808 00000100:00100000:1.0:1788568580.097677:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788568580.097687:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7895:x1875449976215808:12345-0@lo:5: 00000100:00100000:0.0:1788568580.101166:0:7895:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae252512f00 going to sleep for 11 seconds 00002000:00080000:1.0:1788568580.106759:0:6688:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788568580.109580:0:6688:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1788568580.115532:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7895:x1875449976215808:12345-0@lo:5: Request processed in 17839us (17967us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788568580.115544:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788568580.115659:0:7895:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae251dc6680 x1875449976215808/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788568596 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568580.115686:0:7895:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788568580.115716:0:7895:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9ae251dc6680 x1875449976215808/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788568596 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568580.115726:0:7895:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae251dc6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7895:1875449976215808:0@lo:5: 00000004:00080000:0.0:1788568580.115739:0:7895:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1788568580.280157:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568580.599137:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788568580.599164:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae251dc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976215936:0@lo:13: 00000100:00100000:1.0:1788568580.599232:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568580.599301:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976215936 00000100:00100000:1.0:1788568580.599308:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976215936 00000100:00100000:1.0:1788568580.599359:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788568580.599370:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976215936:12345-0@lo:13: 00002000:00000024:1.0:1788568580.599423:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788568580.599471:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976215936:12345-0@lo:13: Request processed in 102us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568580.599478:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788568580.599521:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae251dc6300 x1875449976215936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568596 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568580.599539:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae251dc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976215936:0@lo:13: 00010000:00010000:0.0:1788568581.308503:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788568581.441625:0:7993:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg604-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788568582.329254:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568583.358316:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568584.375151:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568584.695105:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:925db6b8-84bc-418c-b37a-40345c1020be:3308:1875449976216064:0@lo:400: 00000100:00100000:3.0:1788568584.695135:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976216448:0@lo:400: 00000100:00100000:2.0:1788568584.695183:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568584.695185:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568584.695524:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875449976216192:0@lo:400: 00000100:00100000:0.0:1788568584.697964:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976216448 00000100:00100000:0.0:1788568584.697980:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976216448 00000100:00100000:0.0:1788568584.698043:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788568584.698053:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976216448:12345-0@lo:400: 00000100:00100000:2.0:1788568584.700152:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875449976216576:0@lo:400: 00000100:00100000:2.0:1788568584.700217:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568584.700264:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976216064 00000100:00100000:2.0:1788568584.700271:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976216064 00000100:00100000:2.0:1788568584.700313:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788568584.700321:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+19:3308:x1875449976216064:12345-0@lo:400: 00000100:00100000:2.0:1788568584.700386:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+19:3308:x1875449976216064:12345-0@lo:400: Request processed in 65us (5205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568584.700393:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788568584.700428:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976216576 00000100:00100000:2.0:1788568584.700433:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976216576 00000100:00100000:3.0:1788568584.700437:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788568584.700450:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875449976216320:0@lo:400: 00000100:00100000:2.0:1788568584.700469:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788568584.700478:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae1419bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875449976216576:12345-0@lo:400: 00000100:00100000:3.0:1788568584.700488:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568584.700522:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae1419bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875449976216576:12345-0@lo:400: Request processed in 45us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568584.700530:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788568584.700543:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976216320 00000100:00100000:2.0:1788568584.700546:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976216320 00000100:00100000:2.0:1788568584.700571:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788568584.700577:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875449976216320:12345-0@lo:400: 00000100:00100000:2.0:1788568584.700608:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875449976216320:12345-0@lo:400: Request processed in 32us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568584.700614:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1788568584.700658:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae141c30700 x1875449976216576/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568584.700671:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875449976216576:0@lo:400: 00000100:00100000:2.0:1788568584.700683:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:925db6b8-84bc-418c-b37a-40345c1020be:3308:1875449976216064:0@lo:400: 00010000:00080000:2.0:1788568584.700715:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae141c31180 x1875449976216320/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568584.700724:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875449976216320:0@lo:400: 00000100:00100000:1.0:1788568584.701491:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568584.701523:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976216704:0@lo:400: 00000100:00100000:1.0:1788568584.701552:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568584.701606:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788568584.701614:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:1.0:1788568584.701661:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788568584.701665:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788568584.701682:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788568584.701689:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976216704 00000100:00100000:1.0:1788568584.701694:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976216704 00000100:00100000:1.0:1788568584.701724:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788568584.701731:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788568584.701738:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1875449976216704:12345-0@lo:400: 00000100:00100000:1.0:1788568584.701781:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1875449976216704:12345-0@lo:400: Request processed in 43us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568584.701788:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788568584.701803:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788568584.701825:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae141c33b80 x1875449976216704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568584.701850:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976216704:0@lo:400: 00000100:00100000:2.0:1788568584.701993:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976216192 00000100:00100000:2.0:1788568584.702003:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976216192 00000100:00100000:2.0:1788568584.702033:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788568584.702041:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875449976216192:12345-0@lo:400: 00000100:00100000:2.0:1788568584.702081:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875449976216192:12345-0@lo:400: Request processed in 42us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568584.702087:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1788568584.702118:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae141c32300 x1875449976216192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568584.702129:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875449976216192:0@lo:400: 00000100:00100000:0.0:1788568584.706917:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976216448:12345-0@lo:400: Request processed in 8856us (11725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568584.706946:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788568584.707021:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae141c31500 x1875449976216448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568584.707036:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976216448:0@lo:400: 00000100:00100000:0.0:1788568585.212268:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788568585.212295:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976216832:0@lo:13: 00000100:00100000:0.0:1788568585.212363:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568585.212471:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976216832 00000100:00100000:1.0:1788568585.212482:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976216832 00000100:00100000:1.0:1788568585.212531:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788568585.212539:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875449976216832:12345-0@lo:13: 00002000:00000024:1.0:1788568585.212571:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788568585.212616:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875449976216832:12345-0@lo:13: Request processed in 77us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568585.212624:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788568585.221062:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae27bf60700 x1875449976216832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568601 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568585.221086:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976216832:0@lo:13: 00000001:00080000:3.0:1788568585.333920:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1788568585.403347:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568585.732445:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788568585.732471:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae251dc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976216960:0@lo:13: 00000100:00100000:1.0:1788568585.732536:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568585.732594:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976216960 00000100:00100000:1.0:1788568585.732601:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976216960 00000100:00100000:1.0:1788568585.732638:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788568585.732645:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976216960:12345-0@lo:13: 00002000:00000024:1.0:1788568585.732678:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788568585.732722:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976216960:12345-0@lo:13: Request processed in 77us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568585.732729:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788568585.732774:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae251dc7100 x1875449976216960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568601 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568585.732792:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae251dc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976216960:0@lo:13: 00010000:00010000:3.0:1788568586.423161:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568587.248858:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568587.249141:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958367360 00000100:00100000:2.0:1788568587.249153:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958367360 00000100:00100000:2.0:1788568587.249196:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 111 00000100:00100000:2.0:1788568587.249204:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2360:x1875449958367360:12345-192.168.206.4@tcp:250: 00010000:00080000:2.0:1788568587.249230:0:5835:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 3f0f084e-5158-464d-a770-11379825208e@192.168.206.4@tcp t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:2.0:1788568587.249330:0:5835:0:(genops.c:1385:class_connect()) connect: client 3f0f084e-5158-464d-a770-11379825208e, cookie 0x41e82f464b6a0ce5 00000100:00080000:2.0:1788568587.249457:0:5835:0:(import.c:65:import_set_state_nolock()) ffff9ae27bedb800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788568587.249517:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+5:2360:x1875449958367360:12345-192.168.206.4@tcp:250: Request processed in 312us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568587.249525:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 111 00000100:00100000:0.0:1788568587.257409:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568587.257487:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958367488 00000100:00100000:3.0:1788568587.257498:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958367488 00000100:00100000:3.0:1788568587.257549:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 112 00000100:00100000:3.0:1788568587.257558:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+5:5588:x1875449958367488:12345-192.168.206.4@tcp:101: 00010000:00010000:3.0:1788568587.257574:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568587.257590:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae2429df800/0x41e82f464b6a0cec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9be997 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568587.257791:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae2429df800/0x41e82f464b6a0cec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9be997 expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568587.257804:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae2429df800/0x41e82f464b6a0cec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9be997 expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568587.257813:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429df800, rc 0) 00000100:00100000:3.0:1788568587.257915:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+6:5588:x1875449958367488:12345-192.168.206.4@tcp:101: Request processed in 357us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568587.257923:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 112 00000100:00100000:0.0:1788568587.265897:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568587.266149:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958367616 00000100:00100000:3.0:1788568587.266158:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958367616 00000100:00100000:3.0:1788568587.266196:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 113 00000100:00100000:3.0:1788568587.266204:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+6:5588:x1875449958367616:12345-192.168.206.4@tcp:501: 00000100:00100000:3.0:1788568587.266887:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+6:5588:x1875449958367616:12345-192.168.206.4@tcp:501: Request processed in 680us (995us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788568587.266896:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 113 00000100:00100000:1.0:1788568587.273683:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568587.273806:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958367744 00000100:00100000:0.0:1788568587.273817:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958367744 00000100:00100000:0.0:1788568587.273873:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 114 00000100:00100000:0.0:1788568587.273883:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+6:5588:x1875449958367744:12345-192.168.206.4@tcp:101: 00010000:00010000:0.0:1788568587.273910:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568587.274330:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae240030e00/0x41e82f464b6a0cf3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9be99e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568587.274733:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae240030e00/0x41e82f464b6a0cf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9be99e expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568587.274757:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae240030e00/0x41e82f464b6a0cf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9be99e expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568587.274768:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae240030e00, rc 0) 00000100:00100000:1.0:1788568587.274879:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+7:5588:x1875449958367744:12345-192.168.206.4@tcp:101: Request processed in 996us (1204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568587.274888:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 114 00000100:00100000:2.0:1788568587.279829:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568587.279888:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958367872 00000100:00100000:0.0:1788568587.279898:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958367872 00000100:00100000:0.0:1788568587.280042:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 115 00000100:00100000:0.0:1788568587.280053:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+7:5588:x1875449958367872:12345-192.168.206.4@tcp:501: 00000100:00100000:0.0:1788568587.280364:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+8:5588:x1875449958367872:12345-192.168.206.4@tcp:501: Request processed in 309us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568587.280373:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 115 00000100:00100000:0.0:1788568587.284312:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568587.285441:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958368000 00000100:00100000:2.0:1788568587.285456:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958368000 00000100:00100000:2.0:1788568587.285570:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 116 00000100:00100000:2.0:1788568587.285581:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+8:5588:x1875449958368000:12345-192.168.206.4@tcp:503: 00000100:00100000:2.0:1788568587.286081:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+8:5588:x1875449958368000:12345-192.168.206.4@tcp:503: Request processed in 501us (1778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568587.286096:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 116 00000100:00100000:1.0:1788568587.289491:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568587.290266:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958368128 00000100:00100000:3.0:1788568587.290283:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958368128 00000100:00100000:3.0:1788568587.290373:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 117 00000100:00100000:3.0:1788568587.290385:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+8:5607:x1875449958368128:12345-192.168.206.4@tcp:502: 00000100:00100000:0.0:1788568587.297092:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+8:5607:x1875449958368128:12345-192.168.206.4@tcp:502: Request processed in 6692us (7600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568587.297112:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 117 00000100:00100000:1.0:1788568587.321255:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568587.321359:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958368256 00000100:00100000:3.0:1788568587.321373:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958368256 00000100:00100000:3.0:1788568587.321445:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 118 00000100:00100000:3.0:1788568587.321457:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+8:5607:x1875449958368256:12345-192.168.206.4@tcp:502: 00000100:00100000:3.0:1788568587.321822:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+8:5607:x1875449958368256:12345-192.168.206.4@tcp:502: Request processed in 367us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568587.321831:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 118 00000100:00100000:0.0:1788568587.330853:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568587.331001:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958368384 00000100:00100000:1.0:1788568587.331015:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958368384 00000100:00100000:1.0:1788568587.331083:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 119 00000100:00100000:1.0:1788568587.331095:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+8:5588:x1875449958368384:12345-192.168.206.4@tcp:101: 00010000:00010000:1.0:1788568587.331117:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568587.331141:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae282044a00/0x41e82f464b6a0cfa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9be9c8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568587.331177:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae282044a00/0x41e82f464b6a0cfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9be9c8 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568587.331189:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae282044a00/0x41e82f464b6a0cfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9be9c8 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568587.331200:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae282044a00, rc 0) 00000100:00100000:1.0:1788568587.331272:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+9:5588:x1875449958368384:12345-192.168.206.4@tcp:101: Request processed in 180us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568587.331280:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 119 00000100:00100000:1.0:1788568587.338611:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568587.338786:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958368512 00000100:00100000:2.0:1788568587.338800:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958368512 00000100:00100000:2.0:1788568587.338872:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 120 00000100:00100000:2.0:1788568587.338884:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+9:5588:x1875449958368512:12345-192.168.206.4@tcp:256: 20000000:01000000:2.0:1788568587.339108:0:5834:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788568587.339141:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788568587.339145:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788568587.339148:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788568587.339151:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1788568587.348329:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+9:5588:x1875449958368512:12345-192.168.206.4@tcp:256: Request processed in 9428us (9714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568587.348347:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 120 00000100:00100000:2.0:1788568587.357323:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568587.358391:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958368640 00000100:00100000:3.0:1788568587.358410:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958368640 00000100:00100000:3.0:1788568587.358501:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 121 00000100:00100000:3.0:1788568587.358514:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+9:5588:x1875449958368640:12345-192.168.206.4@tcp:101: 00010000:00010000:3.0:1788568587.358537:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568587.358562:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0d01 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9be9cf expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568587.358602:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0d01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9be9cf expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568587.358617:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0d01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9be9cf expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568587.358628:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429dee00, rc 0) 00000100:00100000:3.0:1788568587.358761:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+10:5588:x1875449958368640:12345-192.168.206.4@tcp:101: Request processed in 248us (1454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568587.358768:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 121 00000100:00100000:2.0:1788568587.366007:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568587.366993:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958368768 00000100:00100000:1.0:1788568587.367010:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958368768 00000100:00100000:1.0:1788568587.367074:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 122 00000100:00100000:1.0:1788568587.367085:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae266991850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+10:5588:x1875449958368768:12345-192.168.206.4@tcp:501: 00000100:00100000:0.0:1788568587.370845:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae266991850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+10:5588:x1875449958368768:12345-192.168.206.4@tcp:501: Request processed in 3743us (4831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568587.370864:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 122 00000100:00100000:2.0:1788568587.385983:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568587.386071:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958368896 00000100:00100000:0.0:1788568587.386085:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958368896 00000100:00100000:0.0:1788568587.386163:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 123 00000100:00100000:0.0:1788568587.386175:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae266992450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+10:5588:x1875449958368896:12345-192.168.206.4@tcp:503: 00000100:00100000:0.0:1788568587.386647:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae266992450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+10:5588:x1875449958368896:12345-192.168.206.4@tcp:503: Request processed in 471us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568587.386656:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 123 00000100:00100000:1.0:1788568587.397032:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568587.397142:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958369024 00000100:00100000:0.0:1788568587.397156:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958369024 00000100:00100000:0.0:1788568587.397230:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 124 00000100:00100000:0.0:1788568587.397244:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae252782850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+10:5612:x1875449958369024:12345-192.168.206.4@tcp:502: 00000100:00100000:0.0:1788568587.397636:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae252782850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+10:5612:x1875449958369024:12345-192.168.206.4@tcp:502: Request processed in 394us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568587.397646:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 124 00000100:00100000:2.0:1788568587.402820:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568587.402922:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958369152 00000100:00100000:3.0:1788568587.402975:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958369152 00000100:00100000:3.0:1788568587.403041:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 125 00000100:00100000:3.0:1788568587.403054:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae252783850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+10:5612:x1875449958369152:12345-192.168.206.4@tcp:502: 00000100:00100000:3.0:1788568587.403494:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae252783850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+10:5612:x1875449958369152:12345-192.168.206.4@tcp:502: Request processed in 440us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568587.403516:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 125 00000100:00100000:2.0:1788568587.407258:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568587.407360:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958369280 00000100:00100000:0.0:1788568587.407373:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958369280 00000100:00100000:0.0:1788568587.407463:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 4 00000100:00100000:0.0:1788568587.407475:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae1419be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2360:x1875449958369280:12345-192.168.206.4@tcp:38: 00010000:00080000:0.0:1788568587.407516:0:5844:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 27f83c0c-e36b-48ce-9485-80051fd252dc@192.168.206.4@tcp t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:0.0:1788568587.407575:0:5844:0:(genops.c:1385:class_connect()) connect: client 27f83c0c-e36b-48ce-9485-80051fd252dc, cookie 0x41e82f464b6a0d08 00000004:00100000:0.0:1788568587.407616:0:5844:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1788568587.407624:0:5844:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1788568587.436922:0:5844:0:(import.c:65:import_set_state_nolock()) ffff9ae26f6f8800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788568587.437067:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae1419be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2360:x1875449958369280:12345-192.168.206.4@tcp:38: Request processed in 29590us (29820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568587.437081:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 4 00010000:00010000:2.0:1788568587.447784:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568588.442504:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568588.442551:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568588.442658:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958369408 00000100:00100000:2.0:1788568588.442672:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958369408 00000100:00100000:3.0:1788568588.442704:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958369536 00000100:00100000:3.0:1788568588.442720:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958369536 00000100:00100000:2.0:1788568588.442769:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 5 00000100:00100000:2.0:1788568588.442784:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+7:0:x1875449958369408:12345-192.168.206.4@tcp:41: 00000100:00100000:3.0:1788568588.442797:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 6 00000100:00100000:3.0:1788568588.442827:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+7:5588:x1875449958369536:12345-192.168.206.4@tcp:41: 00000004:00000024:2.0:1788568588.442839:0:5842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000004:00000024:3.0:1788568588.442861:0:6714:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788568588.442980:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+7:5588:x1875449958369536:12345-192.168.206.4@tcp:41: Request processed in 173us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568588.442988:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 6 00000100:00080000:1.0:1788568588.443029:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788568588.443236:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+6:0:x1875449958369408:12345-192.168.206.4@tcp:41: Request processed in 454us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568588.443245:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 5 00000100:00100000:1.0:1788568588.447176:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568588.447267:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958369664 00000100:00100000:3.0:1788568588.447276:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958369664 00000100:00100000:3.0:1788568588.447331:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 7 00000100:00100000:3.0:1788568588.447354:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+6:5588:x1875449958369664:12345-192.168.206.4@tcp:40: 00000100:00100000:3.0:1788568588.447569:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+6:5588:x1875449958369664:12345-192.168.206.4@tcp:40: Request processed in 228us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568588.447577:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 7 00000100:00100000:3.0:1788568588.452318:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568588.452373:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568588.452607:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958370048 00000100:00100000:2.0:1788568588.452617:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958370048 00000100:00100000:2.0:1788568588.452679:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 0 00000100:00100000:2.0:1788568588.452703:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+6:5588:x1875449958370048:12345-192.168.206.4@tcp:33: 00000100:00100000:1.0:1788568588.452977:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958369792 00000100:00100000:1.0:1788568588.452981:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958369792 00000100:00100000:1.0:1788568588.453015:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 8 00000100:00100000:1.0:1788568588.453021:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1875449958369792:12345-192.168.206.4@tcp:8: 00010000:00080000:1.0:1788568588.453044:0:6690:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 27f83c0c-e36b-48ce-9485-80051fd252dc@192.168.206.4@tcp t0 exp 0000000000000000 cur 222 last 0 00000020:00000080:1.0:1788568588.453073:0:6690:0:(genops.c:1385:class_connect()) connect: client 27f83c0c-e36b-48ce-9485-80051fd252dc, cookie 0x41e82f464b6a0d0f 00002000:00100000:1.0:1788568588.453084:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 27f83c0c-e36b-48ce-9485-80051fd252dc/ffff9ae27ff23800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788568588.453105:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788568588.453720:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788568588.453751:0:6690:0:(import.c:65:import_set_state_nolock()) ffff9ae27ff26800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788568588.453808:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2360:x1875449958369792:12345-192.168.206.4@tcp:8: Request processed in 785us (1499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568588.453816:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 8 00000100:00100000:1.0:1788568588.453868:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568588.453985:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568588.454005:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958370176 00000100:00100000:1.0:1788568588.454016:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958370176 00000100:00100000:1.0:1788568588.454043:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 126 00000100:00100000:1.0:1788568588.454051:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae252780c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+10:2364:x1875449958370176:12345-192.168.206.4@tcp:400: 00000100:00100000:1.0:1788568588.454093:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae252780c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+10:2364:x1875449958370176:12345-192.168.206.4@tcp:400: Request processed in 43us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568588.454100:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 126 00000100:00100000:2.0:1788568588.454386:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958369920 00000100:00100000:2.0:1788568588.454391:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958369920 00000100:00100000:2.0:1788568588.454421:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 9 00000100:00100000:2.0:1788568588.454427:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1875449958369920:12345-192.168.206.4@tcp:8: 00010000:00080000:2.0:1788568588.454446:0:6688:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 27f83c0c-e36b-48ce-9485-80051fd252dc@192.168.206.4@tcp t0 exp 0000000000000000 cur 222 last 0 00000020:00000080:2.0:1788568588.454470:0:6688:0:(genops.c:1385:class_connect()) connect: client 27f83c0c-e36b-48ce-9485-80051fd252dc, cookie 0x41e82f464b6a0d16 00002000:00100000:2.0:1788568588.454479:0:6688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 27f83c0c-e36b-48ce-9485-80051fd252dc/ffff9ae27bedf800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788568588.454495:0:6688:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788568588.455051:0:6688:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788568588.455073:0:6688:0:(import.c:65:import_set_state_nolock()) ffff9ae27bed8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788568588.455236:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2360:x1875449958369920:12345-192.168.206.4@tcp:8: Request processed in 806us (1249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568588.455244:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 9 00000004:00080000:2.0:1788568588.469597:0:5845:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 16828us 00010000:00010000:1.0:1788568588.471780:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00200000:1.0:1788568588.480913:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788568588.481067:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+6:5588:x1875449958370048:12345-192.168.206.4@tcp:33: Request processed in 28362us (28687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568588.481087:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 0 00000100:00100000:0.0:1788568588.790267:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568588.790571:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958370304 00000100:00100000:2.0:1788568588.790581:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958370304 00000100:00100000:2.0:1788568588.790644:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 8 00000100:00100000:2.0:1788568588.790654:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+6:5629:x1875449958370304:12345-192.168.206.4@tcp:101: 00010000:00010000:2.0:1788568588.790685:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568588.790735:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a0d1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9be9f9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568588.790805:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b800/0x41e82f464b6a0d24 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568588.790835:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b800/0x41e82f464b6a0d24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568588.790850:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b800/0x41e82f464b6a0d24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788568588.790885:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788568588.790889:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788568588.790904:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b800/0x41e82f464b6a0d24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568588.790981:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a0d1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9be9f9 expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568588.790999:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b800/0x41e82f464b6a0d24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9be9f9 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568588.791008:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae255fb9d00) 00010000:00010000:2.0:1788568588.791010:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788568588.791014:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7b800, rc 0) 00000100:00100000:2.0:1788568588.791068:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+7:5629:x1875449958370304:12345-192.168.206.4@tcp:101: Request processed in 414us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568588.791075:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 8 00010000:00010000:2.0:1788568589.495327:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568589.817608:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976217472:0@lo:400: 00000100:00100000:0.0:1788568589.817677:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568589.817743:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788568589.817751:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875449976217344:0@lo:400: 00000100:00100000:0.0:1788568589.817777:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568589.817809:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976217344 00000100:00100000:0.0:1788568589.817817:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976217344 00000100:00100000:0.0:1788568589.817868:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788568589.817877:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875449976217344:12345-0@lo:400: 00000100:00100000:1.0:1788568589.818014:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875449976217216:0@lo:400: 00000100:00100000:1.0:1788568589.818042:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568589.818060:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976217728:0@lo:400: 00000100:00100000:1.0:1788568589.818079:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568589.818101:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788568589.818106:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925db6b8-84bc-418c-b37a-40345c1020be:3309:1875449976217088:0@lo:400: 00000100:00100000:1.0:1788568589.818131:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568589.818150:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875449976217600:0@lo:400: 00000100:00100000:1.0:1788568589.818174:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568589.818198:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976217472 00000100:00100000:1.0:1788568589.818201:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976217472 00000100:00100000:1.0:1788568589.818230:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976217728 00000100:00100000:1.0:1788568589.818233:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976217728 00000100:00100000:1.0:1788568589.818254:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788568589.818261:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976217472:12345-0@lo:400: 00000100:00100000:1.0:1788568589.818308:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976217472:12345-0@lo:400: Request processed in 47us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568589.818322:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788568589.818338:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788568589.818344:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976217728:12345-0@lo:400: 00000100:00100000:1.0:1788568589.818376:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976217728:12345-0@lo:400: Request processed in 32us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568589.818382:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788568589.818415:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae27bf62d80 x1875449976217728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568589.818426:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788568589.818452:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976217728:0@lo:400: 00000100:00100000:1.0:1788568589.818471:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976217216 00000100:00100000:1.0:1788568589.818475:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976217216 00000100:00100000:1.0:1788568589.818490:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976217600 00000100:00100000:1.0:1788568589.818492:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976217600 00000100:00100000:1.0:1788568589.818506:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788568589.818511:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875449976217216:12345-0@lo:400: 00000100:00100000:1.0:1788568589.818546:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875449976217216:12345-0@lo:400: Request processed in 34us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568589.818552:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788568589.818563:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788568589.818569:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875449976217600:12345-0@lo:400: 00000100:00100000:1.0:1788568589.818809:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875449976217600:12345-0@lo:400: Request processed in 240us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568589.818816:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788568589.818847:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875449976217600:0@lo:400: 00000100:00100000:1.0:1788568589.818868:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875449976217216:0@lo:400: 00000100:00080000:1.0:1788568589.818912:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788568589.818917:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788568589.818920:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788568589.818999:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae27bf62a00 x1875449976217472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568589.819009:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976217472:0@lo:400: 00000100:00100000:0.0:1788568589.819129:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875449976217344:12345-0@lo:400: Request processed in 1253us (1350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568589.819136:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788568589.819272:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976217088 00000100:00100000:3.0:1788568589.819277:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976217088 00000100:00100000:3.0:1788568589.819306:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788568589.819312:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae252780850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+19:3309:x1875449976217088:12345-0@lo:400: 00000100:00100000:3.0:1788568589.819351:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae252780850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+19:3309:x1875449976217088:12345-0@lo:400: Request processed in 40us (1219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568589.819357:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788568589.819641:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925db6b8-84bc-418c-b37a-40345c1020be:3309:1875449976217088:0@lo:400: 00000100:00100000:1.0:1788568589.819780:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875449976217344:0@lo:400: 00000001:00100000:0.0:1788568589.893240:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 27f83c0c-e36b-48ce-9485-80051fd252dc 00000100:00100000:1.0:1788568590.328352:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788568590.328376:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976217856:0@lo:13: 00000100:00100000:1.0:1788568590.328437:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568590.328562:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976217856 00000100:00100000:2.0:1788568590.328569:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976217856 00000100:00100000:2.0:1788568590.328614:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788568590.328623:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976217856:12345-0@lo:13: 00002000:00000024:2.0:1788568590.328680:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788568590.328728:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976217856:12345-0@lo:13: Request processed in 106us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568590.328735:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788568590.329067:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae27bf60000 x1875449976217856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568606 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568590.329087:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976217856:0@lo:13: 00010000:00010000:1.0:1788568590.528146:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568590.839189:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae251dc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976217984:0@lo:13: 00000100:00100000:0.0:1788568590.839273:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568590.839421:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976217984 00000100:00100000:2.0:1788568590.839429:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976217984 00000100:00100000:2.0:1788568590.839475:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788568590.839484:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976217984:12345-0@lo:13: 00002000:00000024:2.0:1788568590.839518:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788568590.839577:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976217984:12345-0@lo:13: Request processed in 94us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568590.839585:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788568590.840020:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae251dc7b80 x1875449976217984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568606 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568590.840040:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae251dc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976217984:0@lo:13: 00000100:00100000:0.0:1788568591.161557:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568591.161953:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958370432 00000100:00100000:2.0:1788568591.161964:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958370432 00000100:00100000:2.0:1788568591.162044:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 9 00000100:00100000:2.0:1788568591.162063:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+7:5681:x1875449958370432:12345-192.168.206.4@tcp:41: 00000004:00000024:2.0:1788568591.162114:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788568591.162192:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+7:5681:x1875449958370432:12345-192.168.206.4@tcp:41: Request processed in 138us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568591.162199:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 9 00000100:00080000:1.0:1788568591.162747:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788568591.171287:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568591.171374:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958370560 00000100:00100000:2.0:1788568591.171384:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958370560 00000100:00100000:2.0:1788568591.171458:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 9 00000100:00100000:2.0:1788568591.171468:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:27f83c0c-e36b-48ce-9485-80051fd252dc+5:5681:x1875449958370560:12345-192.168.206.4@tcp:13: 00002000:00000024:2.0:1788568591.171491:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788568591.171551:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:27f83c0c-e36b-48ce-9485-80051fd252dc+5:5681:x1875449958370560:12345-192.168.206.4@tcp:13: Request processed in 85us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568591.171570:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 9 00000100:00080000:1.0:1788568591.172078:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788568591.175292:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568591.175437:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958370688 00000100:00100000:2.0:1788568591.175446:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958370688 00000100:00100000:2.0:1788568591.175515:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 10 00000100:00100000:2.0:1788568591.175525:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:27f83c0c-e36b-48ce-9485-80051fd252dc+6:5681:x1875449958370688:12345-192.168.206.4@tcp:13: 00002000:00000024:2.0:1788568591.175548:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788568591.175616:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:27f83c0c-e36b-48ce-9485-80051fd252dc+6:5681:x1875449958370688:12345-192.168.206.4@tcp:13: Request processed in 92us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568591.175624:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 10 00000100:00080000:1.0:1788568591.175703:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788568591.543284:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568592.575104:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788568592.958978:0:5865:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 27f83c0c-e36b-48ce-9485-80051fd252dc 00000001:00100000:0.0:1788568592.988835:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 27f83c0c-e36b-48ce-9485-80051fd252dc 00010000:00010000:1.0:1788568593.593083:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568593.940334:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568593.940383:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568593.940425:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568593.940458:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568593.940513:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958370944 00000100:00100000:0.0:1788568593.940527:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958370944 00000100:00100000:0.0:1788568593.940608:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 23 00000100:00100000:0.0:1788568593.940620:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2363:x1875449958370944:12345-192.168.206.4@tcp:400: 00000100:00100000:0.0:1788568593.940718:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2363:x1875449958370944:12345-192.168.206.4@tcp:400: Request processed in 100us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568593.940728:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 23 00000100:00100000:0.0:1788568593.940773:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958371072 00000100:00100000:0.0:1788568593.940778:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958371072 00000100:00100000:0.0:1788568593.940808:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958371200 00000100:00100000:0.0:1788568593.940811:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958371200 00000100:00100000:0.0:1788568593.940836:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 8 00000100:00100000:0.0:1788568593.940843:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2363:x1875449958371072:12345-192.168.206.4@tcp:400: 00000100:00100000:0.0:1788568593.940874:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2363:x1875449958371072:12345-192.168.206.4@tcp:400: Request processed in 32us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568593.940881:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 8 00000100:00100000:0.0:1788568593.940894:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 9 00000100:00100000:0.0:1788568593.940899:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2363:x1875449958371200:12345-192.168.206.4@tcp:400: 00000100:00100000:0.0:1788568593.940972:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2363:x1875449958371200:12345-192.168.206.4@tcp:400: Request processed in 72us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568593.940979:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 9 00000100:00080000:0.0:1788568593.940997:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788568593.941002:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788568593.941004:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788568593.941199:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958370816 00000100:00100000:1.0:1788568593.941204:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958370816 00000100:00100000:1.0:1788568593.941240:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 128 00000100:00100000:1.0:1788568593.941248:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+10:2363:x1875449958370816:12345-192.168.206.4@tcp:400: 00000100:00100000:1.0:1788568593.941277:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+10:2363:x1875449958370816:12345-192.168.206.4@tcp:400: Request processed in 31us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568593.941284:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 128 00000001:02000400:2.0:1788568594.345599:0:8301:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788568594.624649:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568594.935255:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae1419bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875449976218368:0@lo:400: 00000100:00100000:0.0:1788568594.935296:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae1419bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:925db6b8-84bc-418c-b37a-40345c1020be:3308:1875449976218112:0@lo:400: 00000100:00100000:2.0:1788568594.935472:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568594.935563:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae1419bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875449976218240:0@lo:400: 00000100:00100000:0.0:1788568594.937087:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568594.937831:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae1419bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976218496:0@lo:400: 00000100:00100000:3.0:1788568594.937923:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568594.938013:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976218368 00000100:00100000:3.0:1788568594.938023:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976218368 00000100:00100000:3.0:1788568594.938099:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788568594.938113:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae1419bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875449976218368:12345-0@lo:400: 00000100:00100000:3.0:1788568594.938178:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae1419bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875449976218368:12345-0@lo:400: Request processed in 70us (2708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568594.938186:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788568594.938234:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976218496 00000100:00100000:3.0:1788568594.938238:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976218496 00000100:00100000:3.0:1788568594.938269:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788568594.938277:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976218496:12345-0@lo:400: 00000100:00100000:3.0:1788568594.938314:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976218496:12345-0@lo:400: Request processed in 38us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568594.938327:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788568594.938334:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae1419bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875449976218624:0@lo:400: 00000100:00100000:3.0:1788568594.938363:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976218112 00000100:00100000:3.0:1788568594.938369:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976218112 00000100:00080000:0.0:1788568594.938383:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788568594.938390:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788568594.938405:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788568594.938413:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+19:3308:x1875449976218112:12345-0@lo:400: 00000100:00100000:3.0:1788568594.938454:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+19:3308:x1875449976218112:12345-0@lo:400: Request processed in 43us (1376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568594.938462:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00010000:00080000:3.0:1788568594.938514:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae1419bfb80 x1875449976218496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568594.938532:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae1419bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976218496:0@lo:400: 00000100:00100000:2.0:1788568594.940843:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae1419bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875449976218368:0@lo:400: 00000100:00100000:0.0:1788568594.941728:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568594.941816:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae1419bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:925db6b8-84bc-418c-b37a-40345c1020be:3308:1875449976218112:0@lo:400: 00000100:00100000:2.0:1788568594.942760:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976218624 00000100:00100000:2.0:1788568594.942774:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976218624 00000100:00100000:2.0:1788568594.942879:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788568594.942891:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875449976218624:12345-0@lo:400: 00000100:00100000:2.0:1788568594.943046:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875449976218624:12345-0@lo:400: Request processed in 157us (1322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568594.943054:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1788568594.943449:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788568594.943496:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae1419bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875449976218624:0@lo:400: 00000100:00100000:1.0:1788568594.944029:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568594.944090:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae1419bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976218752:0@lo:400: 00000100:00100000:1.0:1788568594.944158:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568594.944317:0:8111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976218752 00000100:00100000:0.0:1788568594.944324:0:8111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976218752 00000100:00100000:0.0:1788568594.944399:0:8111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788568594.944409:0:8111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976218752:12345-0@lo:400: 00000100:00100000:0.0:1788568594.944462:0:8111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976218752:12345-0@lo:400: Request processed in 55us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568594.944470:0:8111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788568594.945090:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976218240 00000100:00100000:3.0:1788568594.945100:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976218240 00000100:00100000:3.0:1788568594.945146:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788568594.945155:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875449976218240:12345-0@lo:400: 00000100:00100000:3.0:1788568594.945207:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875449976218240:12345-0@lo:400: Request processed in 54us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568594.945214:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1788568594.945811:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788568594.945862:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae1419bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875449976218240:0@lo:400: 00010000:00080000:1.0:1788568594.945880:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae1419bdc00 x1875449976218752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568594.945891:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae1419bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976218752:0@lo:400: 00000100:00100000:2.0:1788568595.459469:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26f93ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976218880:0@lo:13: 00000100:00100000:2.0:1788568595.459568:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568595.459778:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976218880 00000100:00100000:1.0:1788568595.459787:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976218880 00000100:00100000:1.0:1788568595.459840:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788568595.459851:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae1419bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976218880:12345-0@lo:13: 00002000:00000024:1.0:1788568595.459886:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788568595.459978:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae1419bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976218880:12345-0@lo:13: Request processed in 128us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568595.459985:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788568595.460255:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae26f93ea00 x1875449976218880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568611 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568595.460291:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26f93ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976218880:0@lo:13: 00010000:00010000:1.0:1788568595.639282:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568595.960082:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788568595.960105:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26f93f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976219008:0@lo:13: 00000100:00100000:1.0:1788568595.960163:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568595.960220:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976219008 00000100:00100000:1.0:1788568595.960226:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976219008 00000100:00100000:1.0:1788568595.960270:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788568595.960278:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976219008:12345-0@lo:13: 00002000:00000024:1.0:1788568595.960311:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788568595.960364:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976219008:12345-0@lo:13: Request processed in 87us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568595.960372:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788568595.960414:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae26f93f800 x1875449976219008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568611 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568595.960433:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26f93f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976219008:0@lo:13: 00010000:00010000:1.0:1788568596.663568:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568597.687153:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568598.711403:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788568598.889105:0:8449:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcda8b5d90 20000000:00000080:1.0:1788568598.889133:0:8449:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ae277c69000 uarg=0000000000000000 20000000:01000000:1.0:1788568598.889187:0:8449:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1788568598.889190:0:8449:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1788568598.889194:0:8449:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788568598.889201:0:8449:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788568598.889207:0:8449:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1788568598.889225:0:8449:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788568598.889228:0:8449:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788568598.889567:0:8449:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788568598.889571:0:8449:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788568598.912401:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1788568598.913213:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1788568598.913296:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1788568598.913336:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1788568598.913353:0:8449:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788568598.913356:0:8449:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788568598.925275:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1788568598.938279:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1788568598.938784:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1788568598.939446:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1788568598.939475:0:8449:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788568598.939479:0:8449:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788568598.948323:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1788568598.952619:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1788568598.952708:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1788568598.952751:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1788568598.952766:0:8449:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788568598.952769:0:8449:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788568598.955261:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1788568598.965058:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1788568598.965145:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1788568598.965212:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:0.0:1788568598.965237:0:8449:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788568598.965261:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ae27feaae00/0x41e82f464b6a0d2b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.965284:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae2429dfe00/0x41e82f464b6a0c28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0c21 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.965801:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae240031a00/0x41e82f464b6a0c52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0c4b expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.965808:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae282045e00/0x41e82f464b6a0c7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0c75 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.965918:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae2429df400/0x41e82f464b6a0c8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0c83 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.966169:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae2429df600/0x41e82f464b6a0c98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0c91 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.966177:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae2429dfa00/0x41e82f464b6a0cb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0cad expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.966183:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae240031c00/0x41e82f464b6a0cde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0cd7 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.966194:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae2429df800/0x41e82f464b6a0cec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9be997 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.966201:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae240030e00/0x41e82f464b6a0cf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9be99e expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.966211:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ae27feaae00/0x41e82f464b6a0d2b lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.966265:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae240030e00/0x41e82f464b6a0cf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9be99e expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.966284:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae240030e00/0x41e82f464b6a0cf3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9be99e expref: 9 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568598.966697:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf63100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875449976219136:192.168.206.4@tcp:104: 00010000:00010000:0.0:1788568598.966922:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae2429df800/0x41e82f464b6a0cec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9be997 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.966972:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae2429df800/0x41e82f464b6a0cec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9be997 expref: 9 pid: 5836 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568598.966982:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf62d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875449976219264:192.168.206.4@tcp:104: 00010000:00010000:0.0:1788568598.967022:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae240031c00/0x41e82f464b6a0cde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x41e82f464b6a0cd7 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.967036:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae240031c00/0x41e82f464b6a0cde lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x41e82f464b6a0cd7 expref: 18 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568598.967045:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae28170a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875449976219392:0@lo:104: 00000100:00100000:0.0:1788568598.967115:0:8449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788568598.967168:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae2429dfa00/0x41e82f464b6a0cb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x41e82f464b6a0cad expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.967177:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae2429dfa00/0x41e82f464b6a0cb4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x41e82f464b6a0cad expref: 18 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568598.967185:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875449976219520:0@lo:104: 00000100:00100000:0.0:1788568598.967214:0:8449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788568598.967246:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae2429df600/0x41e82f464b6a0c98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x41e82f464b6a0c91 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.967255:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae2429df600/0x41e82f464b6a0c98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x41e82f464b6a0c91 expref: 18 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568598.967268:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875449976219648:0@lo:104: 00010000:00010000:0.0:1788568598.967307:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae2429df400/0x41e82f464b6a0c8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x41e82f464b6a0c83 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.967323:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae2429df400/0x41e82f464b6a0c8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x41e82f464b6a0c83 expref: 18 pid: 5836 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568598.967332:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875449976219776:0@lo:104: 00010000:00010000:0.0:1788568598.967364:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae282045e00/0x41e82f464b6a0c7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x41e82f464b6a0c75 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.967372:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae282045e00/0x41e82f464b6a0c7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x41e82f464b6a0c75 expref: 18 pid: 5836 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568598.967380:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875449976219904:0@lo:104: 00010000:00010000:0.0:1788568598.967404:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae240031a00/0x41e82f464b6a0c52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x41e82f464b6a0c4b expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.967412:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae240031a00/0x41e82f464b6a0c52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x41e82f464b6a0c4b expref: 18 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568598.967420:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875449976220032:0@lo:104: 00010000:00010000:0.0:1788568598.967445:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae2429dfe00/0x41e82f464b6a0c28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x41e82f464b6a0c21 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.967454:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae2429dfe00/0x41e82f464b6a0c28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x41e82f464b6a0c21 expref: 18 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568598.967461:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875449976220160:0@lo:104: 00000100:00100000:0.0:1788568598.967479:0:8449:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae25042a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788568598.967739:0:6704:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788568598.967764:0:6704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568598.967794:0:6704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568598.967803:0:6704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568598.967811:0:6704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568598.967819:0:6704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568598.967840:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976219392 00000100:00100000:2.0:1788568598.967849:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976219392 00000100:00100000:2.0:1788568598.967906:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976219520 00000100:00100000:2.0:1788568598.967910:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976219520 00000100:00100000:2.0:1788568598.967921:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976219648 00000100:00100000:2.0:1788568598.967942:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976219648 00000100:00100000:2.0:1788568598.967955:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976219776 00000100:00100000:2.0:1788568598.967957:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976219776 00000100:00100000:2.0:1788568598.967964:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976219904 00000100:00100000:2.0:1788568598.967966:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976219904 00000100:00100000:2.0:1788568598.967974:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976220032 00000100:00100000:2.0:1788568598.967977:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976220032 00000100:00100000:2.0:1788568598.967985:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976220160 00000100:00100000:2.0:1788568598.967987:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976220160 00000100:00100000:2.0:1788568598.968000:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788568598.968009:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fec6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:925db6b8-84bc-418c-b37a-40345c1020be+9:8449:x1875449976219392:12345-0@lo:104: 00010000:00010000:2.0:1788568598.968033:0:6704:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.104@tcp lock: ffff9ae2429df000/0x41e82f464b6a0cd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0cde expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568598.968101:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788568598.968108:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fec6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:925db6b8-84bc-418c-b37a-40345c1020be+9:8449:x1875449976219392:12345-0@lo:104: Request processed in 100us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568598.968115:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788568598.968135:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788568598.968142:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fd6c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:925db6b8-84bc-418c-b37a-40345c1020be+8:8449:x1875449976219520:12345-0@lo:104: 00010000:00010000:2.0:1788568598.968150:0:6704:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.104@tcp lock: ffff9ae240030200/0x41e82f464b6a0cad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0cb4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568598.968187:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788568598.968192:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fd6c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:925db6b8-84bc-418c-b37a-40345c1020be+8:8449:x1875449976219520:12345-0@lo:104: Request processed in 51us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568598.968197:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788568598.968230:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788568598.968235:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae1419bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:925db6b8-84bc-418c-b37a-40345c1020be+7:8449:x1875449976219648:12345-0@lo:104: 00010000:00010000:2.0:1788568598.968242:0:6704:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.104@tcp lock: ffff9ae282045000/0x41e82f464b6a0c91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0c98 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568598.968265:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788568598.968270:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae1419bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:925db6b8-84bc-418c-b37a-40345c1020be+7:8449:x1875449976219648:12345-0@lo:104: Request processed in 35us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568598.968275:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788568598.968284:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788568598.968306:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae1419bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:925db6b8-84bc-418c-b37a-40345c1020be+6:8449:x1875449976219776:12345-0@lo:104: 00010000:00010000:2.0:1788568598.968320:0:6704:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.104@tcp lock: ffff9ae2429df200/0x41e82f464b6a0c83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0c8a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568598.968346:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788568598.968350:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae1419bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:925db6b8-84bc-418c-b37a-40345c1020be+6:8449:x1875449976219776:12345-0@lo:104: Request processed in 45us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568598.968356:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788568598.968367:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788568598.968372:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae1419bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:925db6b8-84bc-418c-b37a-40345c1020be+5:8449:x1875449976219904:12345-0@lo:104: 00010000:00010000:2.0:1788568598.968378:0:6704:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.104@tcp lock: ffff9ae282045a00/0x41e82f464b6a0c75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0c7c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568598.968402:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788568598.968407:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae1419bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:925db6b8-84bc-418c-b37a-40345c1020be+5:8449:x1875449976219904:12345-0@lo:104: Request processed in 35us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568598.968412:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788568598.968423:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788568598.968429:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae1419bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:925db6b8-84bc-418c-b37a-40345c1020be+4:8449:x1875449976220032:12345-0@lo:104: 00010000:00010000:2.0:1788568598.968436:0:6704:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.104@tcp lock: ffff9ae2429dea00/0x41e82f464b6a0c4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0c52 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568598.968463:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1788568598.968467:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae1419bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:925db6b8-84bc-418c-b37a-40345c1020be+4:8449:x1875449976220032:12345-0@lo:104: Request processed in 40us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568598.968473:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788568598.968484:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788568598.968490:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae1419bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:925db6b8-84bc-418c-b37a-40345c1020be+3:8449:x1875449976220160:12345-0@lo:104: 00010000:00010000:2.0:1788568598.968504:0:6704:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.104@tcp lock: ffff9ae252e7bc00/0x41e82f464b6a0c21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0c28 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568598.968532:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1788568598.968537:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae1419bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:925db6b8-84bc-418c-b37a-40345c1020be+3:8449:x1875449976220160:12345-0@lo:104: Request processed in 48us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568598.968543:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788568598.970236:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae28170a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875449976219392:0@lo:104: 00000100:00100000:0.0:1788568598.970255:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875449976219520:0@lo:104: 00000100:00100000:0.0:1788568598.970284:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875449976219648:0@lo:104: 00000100:00100000:0.0:1788568598.970469:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875449976219776:0@lo:104: 00000100:00100000:0.0:1788568598.970479:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875449976219904:0@lo:104: 00000100:00100000:0.0:1788568598.970488:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875449976220032:0@lo:104: 00000100:00100000:0.0:1788568598.970496:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875449976220160:0@lo:104: 00010000:00010000:0.0:1788568598.970538:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788568598.970547:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae2429df000/0x41e82f464b6a0cd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0cde expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.970557:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429df000 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:0.0:1788568598.970562:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae2429df000/0x41e82f464b6a0cd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x41e82f464b6a0cde expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.970573:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae2429df000/0x41e82f464b6a0cd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x41e82f464b6a0cde expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788568598.970581:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae2429df000/0x41e82f464b6a0cd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x41e82f464b6a0cde expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568598.970587:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788568598.970865:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae2429df000/0x41e82f464b6a0cd7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0cde expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.970873:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788568598.970922:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae2429df000/0x41e82f464b6a0cd7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0cde expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.970957:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae2429df000/0x41e82f464b6a0cd7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0cde expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.970987:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788568598.970991:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae240030200/0x41e82f464b6a0cad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0cb4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.970996:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae240030200 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:0.0:1788568598.970999:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae240030200/0x41e82f464b6a0cad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x41e82f464b6a0cb4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.971007:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae240030200/0x41e82f464b6a0cad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x41e82f464b6a0cb4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788568598.971014:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae240030200/0x41e82f464b6a0cad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x41e82f464b6a0cb4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568598.971020:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788568598.971126:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:925db6b8-84bc-418c-b37a-40345c1020be:3308:1875449976220288:0@lo:103: 00000100:00100000:2.0:1788568598.971222:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568598.971305:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976220288 00000100:00100000:2.0:1788568598.971314:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976220288 00010000:00010000:2.0:1788568598.971346:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae240031c00/0x41e82f464b6a0cde lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0cd7 expref: 19 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568598.971379:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788568598.971389:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae1419bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:925db6b8-84bc-418c-b37a-40345c1020be+19:3308:x1875449976220288:12345-0@lo:103: 00010000:00010000:2.0:1788568598.971404:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568598.971411:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae240031c00/0x41e82f464b6a0cde lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0cd7 expref: 19 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568598.971422:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae240031c00/0x41e82f464b6a0cde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x41e82f464b6a0cd7 expref: 19 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568598.971439:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae240031c00/0x41e82f464b6a0cde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x41e82f464b6a0cd7 expref: 19 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568598.971457:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568598.971495:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae1419bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:925db6b8-84bc-418c-b37a-40345c1020be+18:3308:x1875449976220288:12345-0@lo:103: Request processed in 107us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568598.971513:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788568598.971553:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:925db6b8-84bc-418c-b37a-40345c1020be:3308:1875449976220288:0@lo:103: 00010000:00010000:1.0:1788568598.973595:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788568598.978099:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae240030200/0x41e82f464b6a0cad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0cb4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.978121:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788568598.978195:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925db6b8-84bc-418c-b37a-40345c1020be:3309:1875449976220416:0@lo:103: 00000100:00100000:2.0:1788568598.978289:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788568598.978394:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae240030200/0x41e82f464b6a0cad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0cb4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.978404:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae240030200/0x41e82f464b6a0cad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0cb4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.978426:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788568598.978431:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae2429df200/0x41e82f464b6a0c83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0c8a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.978460:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429df200 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:0.0:1788568598.978553:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae2429df200/0x41e82f464b6a0c83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x41e82f464b6a0c8a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.978565:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae2429df200/0x41e82f464b6a0c83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x41e82f464b6a0c8a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788568598.978573:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae2429df200/0x41e82f464b6a0c83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x41e82f464b6a0c8a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568598.978579:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788568598.978606:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae2429df200/0x41e82f464b6a0c83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0c8a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.978623:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788568598.978641:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae2429df200/0x41e82f464b6a0c83 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0c8a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.978648:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae2429df200/0x41e82f464b6a0c83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0c8a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.978658:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788568598.978661:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae282045a00/0x41e82f464b6a0c75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0c7c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.978668:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae282045a00 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:0.0:1788568598.978676:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae282045a00/0x41e82f464b6a0c75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x41e82f464b6a0c7c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.978694:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae282045a00/0x41e82f464b6a0c75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x41e82f464b6a0c7c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788568598.978700:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae282045a00/0x41e82f464b6a0c75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x41e82f464b6a0c7c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568598.978705:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788568598.978721:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae282045a00/0x41e82f464b6a0c75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0c7c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.978728:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788568598.978734:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae282045a00/0x41e82f464b6a0c75 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0c7c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.978741:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae282045a00/0x41e82f464b6a0c75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0c7c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.978753:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788568598.978756:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae2429dea00/0x41e82f464b6a0c4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0c52 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.978761:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429dea00 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:0.0:1788568598.978764:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae2429dea00/0x41e82f464b6a0c4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x41e82f464b6a0c52 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.978771:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae2429dea00/0x41e82f464b6a0c4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x41e82f464b6a0c52 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788568598.978778:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae2429dea00/0x41e82f464b6a0c4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x41e82f464b6a0c52 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568598.978791:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788568598.978808:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae2429dea00/0x41e82f464b6a0c4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0c52 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.978815:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788568598.978822:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976220416 00010000:00010000:1.0:1788568598.978980:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788568598.978991:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae282045000/0x41e82f464b6a0c91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0c98 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568598.978999:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae282045000 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:1.0:1788568598.979002:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae282045000/0x41e82f464b6a0c91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x41e82f464b6a0c98 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568598.979010:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae282045000/0x41e82f464b6a0c91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x41e82f464b6a0c98 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788568598.979017:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae282045000/0x41e82f464b6a0c91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x41e82f464b6a0c98 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788568598.979022:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788568598.979041:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae282045000/0x41e82f464b6a0c91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0c98 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568598.979047:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788568598.979397:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976220416 00010000:00010000:3.0:1788568598.979438:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae2429dfa00/0x41e82f464b6a0cb4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0cad expref: 18 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568598.979479:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788568598.979490:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae1419bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:925db6b8-84bc-418c-b37a-40345c1020be+18:3309:x1875449976220416:12345-0@lo:103: 00010000:00010000:3.0:1788568598.979505:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568598.979511:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae2429dfa00/0x41e82f464b6a0cb4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0cad expref: 18 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568598.979523:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae2429dfa00/0x41e82f464b6a0cb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x41e82f464b6a0cad expref: 18 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568598.979552:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae2429dfa00/0x41e82f464b6a0cb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x41e82f464b6a0cad expref: 18 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568598.979571:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788568598.980300:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae2429dea00/0x41e82f464b6a0c4b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0c52 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.980315:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae2429dea00/0x41e82f464b6a0c4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0c52 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.980333:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568598.980335:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568598.980338:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568598.980364:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976220544:0@lo:103: 00000100:00100000:2.0:1788568598.980451:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26f93f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925db6b8-84bc-418c-b37a-40345c1020be:3309:1875449976220928:0@lo:103: 00010000:00010000:1.0:1788568598.980991:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae282045000/0x41e82f464b6a0c91 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0c98 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568598.981003:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae282045000/0x41e82f464b6a0c91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0c98 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568598.981013:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788568598.981018:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568598.981021:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568598.981024:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568598.981087:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788568598.981097:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976220672:0@lo:103: 00000100:00100000:0.0:1788568598.981128:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568598.981225:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568598.981247:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568598.981296:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf63100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875449976219136:192.168.206.4@tcp:104: 00000100:00100000:0.0:1788568598.981308:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf62d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875449976219264:192.168.206.4@tcp:104: 00010000:00010000:0.0:1788568598.981369:0:8449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ae27feaae00/0x41e82f464b6a0d2b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568598.981394:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae1419bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:925db6b8-84bc-418c-b37a-40345c1020be+17:3309:x1875449976220416:12345-0@lo:103: Request processed in 1902us (3101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568598.981413:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788568598.981458:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976220544 00000100:00100000:3.0:1788568598.981465:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976220544 00000100:00100000:2.0:1788568598.981490:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788568598.981498:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae2429df400/0x41e82f464b6a0c8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0c83 expref: 17 pid: 5836 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568598.981513:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925db6b8-84bc-418c-b37a-40345c1020be:3309:1875449976220416:0@lo:103: 00000100:00100000:3.0:1788568598.981518:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976220672 00000100:00100000:3.0:1788568598.981522:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976220672 00000100:00100000:2.0:1788568598.981530:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1788568598.981537:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae282045e00/0x41e82f464b6a0c7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0c75 expref: 18 pid: 5836 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568598.981539:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925db6b8-84bc-418c-b37a-40345c1020be:3309:1875449976220800:0@lo:103: 00000100:00100000:3.0:1788568598.981557:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958371328 00000100:00100000:3.0:1788568598.981561:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958371328 00000100:00100000:2.0:1788568598.981571:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788568598.981579:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae240030e00/0x41e82f464b6a0cf3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9be99e expref: 10 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568598.981596:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958371456 00000100:00100000:2.0:1788568598.981599:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976220928 00000100:00100000:3.0:1788568598.981600:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958371456 00000100:00100000:2.0:1788568598.981606:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976220928 00010000:00010000:2.0:1788568598.981626:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae2429df600/0x41e82f464b6a0c98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0c91 expref: 19 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568598.981642:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976220800 00000100:00100000:2.0:1788568598.981645:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976220800 00010000:00010000:2.0:1788568598.981656:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae240031a00/0x41e82f464b6a0c52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0c4b expref: 20 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568598.981670:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788568598.981678:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:925db6b8-84bc-418c-b37a-40345c1020be+20:3306:x1875449976220544:12345-0@lo:103: 00010000:00010000:2.0:1788568598.981693:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568598.981699:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae2429df400/0x41e82f464b6a0c8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0c83 expref: 20 pid: 5836 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568598.981723:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae2429df400/0x41e82f464b6a0c8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x41e82f464b6a0c83 expref: 20 pid: 5836 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568598.981743:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae2429df400/0x41e82f464b6a0c8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x41e82f464b6a0c83 expref: 20 pid: 5836 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568598.981757:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568598.981794:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:925db6b8-84bc-418c-b37a-40345c1020be+19:3306:x1875449976220544:12345-0@lo:103: Request processed in 116us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568598.981801:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788568598.981814:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788568598.981820:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fec4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:925db6b8-84bc-418c-b37a-40345c1020be+18:3306:x1875449976220672:12345-0@lo:103: 00010000:00010000:2.0:1788568598.981828:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568598.981832:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae282045e00/0x41e82f464b6a0c7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0c75 expref: 18 pid: 5836 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568598.981986:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 16 00000100:00100000:0.0:1788568598.982001:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f0f084e-5158-464d-a770-11379825208e+10:2363:x1875449958371328:12345-192.168.206.4@tcp:103: 00010000:00010000:0.0:1788568598.982013:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568598.982018:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae240030e00/0x41e82f464b6a0cf3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9be99e expref: 10 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.982029:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae240030e00/0x41e82f464b6a0cf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9be99e expref: 10 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.982105:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae240030e00/0x41e82f464b6a0cf3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9be99e expref: 10 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.982117:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788568598.982162:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f0f084e-5158-464d-a770-11379825208e+9:2363:x1875449958371328:12345-192.168.206.4@tcp:103: Request processed in 162us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568598.982169:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 16 00000100:00100000:0.0:1788568598.982185:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788568598.982191:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25319cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:925db6b8-84bc-418c-b37a-40345c1020be+18:3309:x1875449976220928:12345-0@lo:103: 00010000:00010000:0.0:1788568598.982199:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568598.982203:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae2429df600/0x41e82f464b6a0c98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0c91 expref: 18 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.982213:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae2429df600/0x41e82f464b6a0c98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x41e82f464b6a0c91 expref: 18 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.982222:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae2429df600/0x41e82f464b6a0c98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x41e82f464b6a0c91 expref: 18 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.982231:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788568598.982262:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25319cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:925db6b8-84bc-418c-b37a-40345c1020be+17:3309:x1875449976220928:12345-0@lo:103: Request processed in 71us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568598.982275:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788568598.982289:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788568598.982296:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cce6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:925db6b8-84bc-418c-b37a-40345c1020be+16:3309:x1875449976220800:12345-0@lo:103: 00010000:00010000:0.0:1788568598.982304:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568598.982308:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae240031a00/0x41e82f464b6a0c52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0c4b expref: 16 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.982317:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae240031a00/0x41e82f464b6a0c52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x41e82f464b6a0c4b expref: 16 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.982326:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae240031a00/0x41e82f464b6a0c52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x41e82f464b6a0c4b expref: 16 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.982336:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788568598.982359:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cce6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:925db6b8-84bc-418c-b37a-40345c1020be+15:3309:x1875449976220800:12345-0@lo:103: Request processed in 63us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568598.982365:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788568598.982516:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976220544:0@lo:103: 00010000:00010000:2.0:1788568598.982694:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae282045e00/0x41e82f464b6a0c7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x41e82f464b6a0c75 expref: 14 pid: 5836 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568598.982705:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae282045e00/0x41e82f464b6a0c7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x41e82f464b6a0c75 expref: 14 pid: 5836 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568598.982715:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568598.982753:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fec4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:925db6b8-84bc-418c-b37a-40345c1020be+13:3306:x1875449976220672:12345-0@lo:103: Request processed in 932us (1624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568598.982760:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788568598.982789:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925db6b8-84bc-418c-b37a-40345c1020be:3309:1875449976220800:0@lo:103: 00000100:00100000:2.0:1788568598.982798:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26f93f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925db6b8-84bc-418c-b37a-40345c1020be:3309:1875449976220928:0@lo:103: 00000100:00100000:0.0:1788568598.983056:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976220672:0@lo:103: 00010000:00010000:3.0:1788568598.984014:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae2429df800/0x41e82f464b6a0cec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9be997 expref: 9 pid: 5836 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568598.984057:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 19 00000100:00100000:3.0:1788568598.984067:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fec7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3f0f084e-5158-464d-a770-11379825208e+9:2363:x1875449958371456:12345-192.168.206.4@tcp:103: 00010000:00010000:3.0:1788568598.984081:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568598.984087:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae2429df800/0x41e82f464b6a0cec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9be997 expref: 9 pid: 5836 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568598.984101:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae2429df800/0x41e82f464b6a0cec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9be997 expref: 9 pid: 5836 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568598.984119:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae2429df800/0x41e82f464b6a0cec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9be997 expref: 9 pid: 5836 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568598.984716:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788568598.984802:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fec7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3f0f084e-5158-464d-a770-11379825208e+8:2363:x1875449958371456:12345-192.168.206.4@tcp:103: Request processed in 734us (3550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568598.984811:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 19 00010000:00010000:0.0:1788568598.988242:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568598.988249:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568598.988252:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568598.988374:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae252e7bc00/0x41e82f464b6a0c21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0c28 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568598.988409:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7bc00 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:1.0:1788568598.988414:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae252e7bc00/0x41e82f464b6a0c21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x41e82f464b6a0c28 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568598.988425:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae252e7bc00/0x41e82f464b6a0c21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x41e82f464b6a0c28 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788568598.988433:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae252e7bc00/0x41e82f464b6a0c21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x41e82f464b6a0c28 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788568598.988439:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788568598.988511:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae252e7bc00/0x41e82f464b6a0c21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0c28 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568598.988518:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788568598.988552:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae252e7bc00/0x41e82f464b6a0c21 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0c28 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568598.988560:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae252e7bc00/0x41e82f464b6a0c21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0c28 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568598.988586:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26f93ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976221056:0@lo:103: 00010000:00010000:1.0:1788568598.988593:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568598.988596:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568598.988599:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568598.988686:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568598.988743:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976221056 00000100:00100000:2.0:1788568598.988753:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976221056 00010000:00010000:2.0:1788568598.988786:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae2429dfe00/0x41e82f464b6a0c28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0c21 expref: 13 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568598.988836:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788568598.988847:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fec4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:925db6b8-84bc-418c-b37a-40345c1020be+13:3306:x1875449976221056:12345-0@lo:103: 00010000:00010000:2.0:1788568598.988863:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568598.988869:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae2429dfe00/0x41e82f464b6a0c28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0c21 expref: 13 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568598.988893:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae2429dfe00/0x41e82f464b6a0c28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x41e82f464b6a0c21 expref: 13 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568598.988910:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae2429dfe00/0x41e82f464b6a0c28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x41e82f464b6a0c21 expref: 13 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568598.988961:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ae27feaae00/0x41e82f464b6a0d2b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568598.988971:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae27feaae00/0x41e82f464b6a0d2b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568598.988988:0:6705:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae27feaae00/0x41e82f464b6a0d2b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568598.988996:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae27feaae00/0x41e82f464b6a0d2b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568598.989005:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ae27feaae00/0x41e82f464b6a0d2b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568598.989024:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ae27feaae00/0x41e82f464b6a0d2b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568598.989030:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaae00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:2.0:1788568598.989035:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ae27feaae00/0x41e82f464b6a0d2b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568598.989043:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ae27feaae00/0x41e82f464b6a0d2b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568598.989063:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ae27feaae00/0x41e82f464b6a0d2b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568598.989075:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568598.989122:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fec4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:925db6b8-84bc-418c-b37a-40345c1020be+12:3306:x1875449976221056:12345-0@lo:103: Request processed in 276us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568598.989129:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788568598.989173:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26f93ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976221056:0@lo:103: 00010000:00010000:0.0:1788568598.989243:0:8449:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ae27feaae00/0x41e82f464b6a0d2b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.989267:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ae27feaae00/0x41e82f464b6a0d2b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568598.989274:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae27feaae00/0x41e82f464b6a0d2b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568599.072791:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568599.072961:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568599.072992:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568599.073022:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958371840 00000100:00100000:1.0:1788568599.073034:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958371840 00000100:00100000:1.0:1788568599.073115:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958371712 00000100:00100000:1.0:1788568599.073119:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958371712 00000100:00100000:1.0:1788568599.073146:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 12 00000100:00100000:1.0:1788568599.073156:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2363:x1875449958371840:12345-192.168.206.4@tcp:400: 00000100:00100000:1.0:1788568599.073241:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2363:x1875449958371840:12345-192.168.206.4@tcp:400: Request processed in 87us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568599.073248:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 12 00000100:00100000:1.0:1788568599.073264:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 13 00000100:00100000:1.0:1788568599.073270:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2363:x1875449958371712:12345-192.168.206.4@tcp:400: 00000100:00100000:1.0:1788568599.074445:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2363:x1875449958371712:12345-192.168.206.4@tcp:400: Request processed in 1164us (1441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568599.074458:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 13 00000100:00080000:1.0:1788568599.074502:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788568599.074508:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788568599.075758:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958371584 00000100:00100000:0.0:1788568599.075773:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958371584 00000100:00100000:0.0:1788568599.075996:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 27 00000100:00100000:0.0:1788568599.076019:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2363:x1875449958371584:12345-192.168.206.4@tcp:400: 00000100:00100000:0.0:1788568599.076119:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2363:x1875449958371584:12345-192.168.206.4@tcp:400: Request processed in 103us (3339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568599.076126:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 27 00000100:00080000:1.0:1788568599.081009:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788568599.735285:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568600.055324:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875449976221440:0@lo:400: 00000100:00100000:3.0:1788568600.055416:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568600.055503:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788568600.055509:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875449976221312:0@lo:400: 00000100:00100000:3.0:1788568600.055536:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568600.055552:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976221824:0@lo:400: 00000100:00100000:3.0:1788568600.055579:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568600.055620:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976221440 00000100:00100000:3.0:1788568600.055628:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976221440 00000100:00100000:3.0:1788568600.055686:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976221312 00000100:00100000:3.0:1788568600.055690:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976221312 00000100:00100000:3.0:1788568600.055719:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788568600.055728:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875449976221440:12345-0@lo:400: 00000100:00100000:3.0:1788568600.055792:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875449976221440:12345-0@lo:400: Request processed in 65us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568600.055801:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788568600.055821:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788568600.055828:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875449976221312:12345-0@lo:400: 00000100:00100000:3.0:1788568600.055854:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875449976221312:12345-0@lo:400: Request processed in 28us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568600.055859:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788568600.055954:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875449976221312:0@lo:400: 00000100:00100000:3.0:1788568600.055968:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875449976221440:0@lo:400: 00000100:00100000:2.0:1788568600.056033:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976221568:0@lo:400: 00000100:00100000:2.0:1788568600.056067:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568600.056093:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788568600.056099:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976221184:0@lo:400: 00000100:00100000:2.0:1788568600.056130:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568600.056151:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875449976221696:0@lo:400: 00000100:00100000:2.0:1788568600.056173:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568600.056200:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976221696 00000100:00100000:2.0:1788568600.056204:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976221696 00000100:00100000:2.0:1788568600.056243:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788568600.056249:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cce6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875449976221696:12345-0@lo:400: 00000100:00100000:2.0:1788568600.056285:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cce6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875449976221696:12345-0@lo:400: Request processed in 36us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568600.056291:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788568600.056320:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875449976221696:0@lo:400: 00000100:00100000:1.0:1788568600.056745:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976221824 00000100:00100000:1.0:1788568600.056751:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976221824 00000100:00100000:1.0:1788568600.056794:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976221568 00000100:00100000:1.0:1788568600.056797:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976221568 00000100:00100000:1.0:1788568600.056827:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788568600.056836:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976221824:12345-0@lo:400: 00000100:00100000:1.0:1788568600.056899:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976221824:12345-0@lo:400: Request processed in 64us (1318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568600.056905:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788568600.056918:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788568600.056955:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cce5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976221568:12345-0@lo:400: 00000100:00100000:1.0:1788568600.056992:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cce5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976221568:12345-0@lo:400: Request processed in 68us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568600.057009:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788568600.057028:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788568600.057033:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788568600.057035:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788568600.057050:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976221184 00000100:00100000:1.0:1788568600.057054:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976221184 00000100:00100000:1.0:1788568600.057086:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788568600.057094:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+12:3306:x1875449976221184:12345-0@lo:400: 00000100:00100000:1.0:1788568600.057131:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+12:3306:x1875449976221184:12345-0@lo:400: Request processed in 39us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568600.057137:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788568600.057198:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976221184:0@lo:400: 00010000:00080000:1.0:1788568600.057215:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae141c30380 x1875449976221568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568600.057227:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976221568:0@lo:400: 00010000:00080000:1.0:1788568600.057262:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae141c31500 x1875449976221824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568600.057272:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976221824:0@lo:400: 00000100:00100000:0.0:1788568600.567253:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788568600.567290:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26f93f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976221952:0@lo:13: 00000100:00100000:0.0:1788568600.567387:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568600.567543:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976221952 00000100:00100000:1.0:1788568600.567554:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976221952 00000100:00100000:1.0:1788568600.567638:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788568600.567649:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976221952:12345-0@lo:13: 00002000:00000024:1.0:1788568600.567696:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788568600.567768:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976221952:12345-0@lo:13: Request processed in 120us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568600.567798:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788568600.568191:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae26f93f100 x1875449976221952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568616 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568600.568215:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26f93f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976221952:0@lo:13: 00010000:00010000:1.0:1788568600.759293:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788568600.759383:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788568600.759394:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ae277b92800 from 39 10000000:01000000:2.0:1788568600.759401:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788568600.759464:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a000/0x41e82f464b6a0d32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568600.759601:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a000/0x41e82f464b6a0d32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568600.759615:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a000/0x41e82f464b6a0d32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568600.759649:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976222080:0@lo:101: 00000100:00100000:2.0:1788568600.759741:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568600.761067:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976222080 00000100:00100000:0.0:1788568600.761081:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976222080 00000100:00100000:2.0:1788568600.761116:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae244519f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788568600.761139:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788568600.761150:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+12:5838:x1875449976222080:12345-0@lo:101: 00010000:00010000:0.0:1788568600.761168:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568600.761190:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae27feaae00/0x41e82f464b6a0d39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0d32 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568600.761239:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae27feaae00/0x41e82f464b6a0d39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0d32 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568600.761251:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae27feaae00/0x41e82f464b6a0d39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0d32 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568600.761262:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae27feaae00, rc 0) 00000100:00100000:0.0:1788568600.761333:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+13:5838:x1875449976222080:12345-0@lo:101: Request processed in 185us (1592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568600.761340:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788568600.761832:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976222080:0@lo:101: 00010000:00010000:2.0:1788568600.761854:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a000/0x41e82f464b6a0d32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0d39 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568600.761864:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a000/0x41e82f464b6a0d32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0d39 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568600.763269:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976222208:0@lo:501: 00000100:00100000:2.0:1788568600.763364:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568600.763423:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae244519f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788568600.764597:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976222208 00000100:00100000:3.0:1788568600.764611:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976222208 00000100:00100000:3.0:1788568600.764685:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788568600.764697:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+13:5838:x1875449976222208:12345-0@lo:501: 00000100:00100000:3.0:1788568600.765444:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+13:5838:x1875449976222208:12345-0@lo:501: Request processed in 745us (2075us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568600.765454:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788568600.768596:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976222208:0@lo:501: 00000100:00100000:2.0:1788568600.768683:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976222336:0@lo:503: 00000100:00100000:2.0:1788568600.768797:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568600.768858:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae244519f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788568600.769041:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976222336 00000100:00100000:1.0:1788568600.769051:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976222336 00000100:00100000:1.0:1788568600.769121:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788568600.769133:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+13:5838:x1875449976222336:12345-0@lo:503: 00000100:00100000:1.0:1788568600.769391:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+13:5838:x1875449976222336:12345-0@lo:503: Request processed in 260us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568600.769399:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788568600.769690:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976222336:0@lo:503: 00000100:00100000:2.0:1788568600.773618:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:8467:1875449976222464:0@lo:502: 00000100:00100000:2.0:1788568600.773736:0:8467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568600.775910:0:8467:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae244519240 going to sleep for 11 seconds 00000100:00100000:0.0:1788568600.776199:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976222464 00000100:00100000:0.0:1788568600.776212:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976222464 00000100:00100000:0.0:1788568600.776285:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788568600.776298:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+13:8467:x1875449976222464:12345-0@lo:502: 00000100:00100000:0.0:1788568600.776658:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+13:8467:x1875449976222464:12345-0@lo:502: Request processed in 362us (2921us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568600.776667:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788568600.776710:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:8467:1875449976222464:0@lo:502: 00000100:00100000:3.0:1788568600.776806:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c30a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:8467:1875449976222592:0@lo:502: 00000100:00100000:3.0:1788568600.776878:0:8467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568600.776912:0:8467:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae252512840 going to sleep for 11 seconds 00000100:00100000:1.0:1788568600.777400:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976222592 00000100:00100000:1.0:1788568600.777408:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976222592 00000100:00100000:1.0:1788568600.777458:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788568600.777468:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+13:8467:x1875449976222592:12345-0@lo:502: 00000100:00100000:1.0:1788568600.777700:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+13:8467:x1875449976222592:12345-0@lo:502: Request processed in 232us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568600.777707:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788568600.777775:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c30a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:8467:1875449976222592:0@lo:502: 00000040:00080000:3.0:1788568600.777809:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788568600.778189:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788568600.778210:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788568600.778223:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a000/0x41e82f464b6a0d32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0d39 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568600.778236:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a000/0x41e82f464b6a0d32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0d39 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568600.778247:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788568600.778251:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1788568600.778254:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788568600.778300:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae27feaac00/0x41e82f464b6a0d40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568600.778310:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae27feaac00/0x41e82f464b6a0d40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568600.778320:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae27feaac00/0x41e82f464b6a0d40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568600.778340:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976222720:0@lo:101: 00000100:00100000:0.0:1788568600.778392:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568600.778471:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae25042ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788568600.784294:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976222720 00000100:00100000:3.0:1788568600.784314:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976222720 00000100:00100000:3.0:1788568600.784404:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788568600.784417:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+13:5838:x1875449976222720:12345-0@lo:101: 00010000:00010000:3.0:1788568600.784439:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568600.784466:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae2429df800/0x41e82f464b6a0d47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0d40 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568600.784501:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae2429df800/0x41e82f464b6a0d47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0d40 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568600.784540:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae2429df800/0x41e82f464b6a0d47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0d40 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568600.784551:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429df800, rc 0) 00000100:00100000:3.0:1788568600.784685:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+14:5838:x1875449976222720:12345-0@lo:101: Request processed in 271us (6292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568600.784693:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788568600.787110:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976222720:0@lo:101: 00010000:00010000:2.0:1788568600.787147:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae27feaac00/0x41e82f464b6a0d40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0d47 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568600.787161:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae27feaac00/0x41e82f464b6a0d40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0d47 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568600.787269:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976222848:0@lo:501: 00000100:00100000:2.0:1788568600.787343:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568600.787401:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae26fb73e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788568600.787480:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976222848 00000100:00100000:0.0:1788568600.787488:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976222848 00000100:00100000:0.0:1788568600.787541:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788568600.787552:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+14:5838:x1875449976222848:12345-0@lo:501: 00000100:00100000:0.0:1788568600.788569:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+14:5838:x1875449976222848:12345-0@lo:501: Request processed in 1014us (1221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568600.788581:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788568600.799066:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976222848:0@lo:501: 00000100:00100000:2.0:1788568600.799159:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976222976:0@lo:503: 00000100:00100000:2.0:1788568600.799277:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568600.799331:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae26fb73e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788568600.799692:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976222976 00000100:00100000:1.0:1788568600.799701:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976222976 00000100:00100000:1.0:1788568600.799772:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788568600.799784:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+14:5838:x1875449976222976:12345-0@lo:503: 00000100:00100000:1.0:1788568600.800092:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+14:5838:x1875449976222976:12345-0@lo:503: Request processed in 310us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568600.800101:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788568600.800473:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976222976:0@lo:503: 00000100:00100000:2.0:1788568600.802272:0:8468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:8468:1875449976223104:0@lo:502: 00000100:00100000:2.0:1788568600.802368:0:8468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568600.802413:0:8468:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae26fb73840 going to sleep for 11 seconds 00000100:00100000:0.0:1788568600.802483:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976223104 00000100:00100000:0.0:1788568600.802492:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976223104 00000100:00100000:0.0:1788568600.802548:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788568600.802559:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+14:8468:x1875449976223104:12345-0@lo:502: 00000100:00100000:0.0:1788568600.802841:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+14:8468:x1875449976223104:12345-0@lo:502: Request processed in 282us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568600.802850:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788568600.804286:0:8468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:8468:1875449976223104:0@lo:502: 00000020:01000000:2.0:1788568600.804344:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788568600.804358:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788568600.804360:0:8468:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788568600.804367:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788568600.804408:0:8468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:8468:1875449976223232:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788568600.804484:0:8468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568600.804534:0:8468:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae26fb73840 going to sleep for 11 seconds 00000100:00100000:0.0:1788568600.804603:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976223232 00000100:00100000:0.0:1788568600.804611:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976223232 00000100:00100000:0.0:1788568600.804674:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788568600.804693:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+14:8468:x1875449976223232:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788568600.804982:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+14:8468:x1875449976223232:12345-0@lo:502:llog_process_th.0 Request processed in 290us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568600.804991:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788568600.805277:0:8468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:8468:1875449976223232:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788568600.805309:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788568600.805315:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788568600.805317:0:8468:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788568600.805324:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1788568600.807236:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1788568600.807275:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788568600.807289:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae27feaac00/0x41e82f464b6a0d40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0d47 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568600.807303:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae27feaac00/0x41e82f464b6a0d40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0d47 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568600.807316:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788568600.807319:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ae27bf74800 from 39 10000000:01000000:0.0:1788568600.807322:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788568600.807440:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae27feab400/0x41e82f464b6a0d4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568600.807451:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae27feab400/0x41e82f464b6a0d4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568600.807462:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae27feab400/0x41e82f464b6a0d4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568600.807493:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976223360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788568600.807571:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568600.807623:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae25042ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788568600.807864:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976223360 00000100:00100000:1.0:1788568600.807886:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976223360 00000100:00100000:1.0:1788568600.808121:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788568600.808132:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+14:5838:x1875449976223360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788568600.808171:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568600.808188:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae282044400/0x41e82f464b6a0d55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0d4e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568600.808218:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae282044400/0x41e82f464b6a0d55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0d4e expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568600.808230:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae282044400/0x41e82f464b6a0d55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0d4e expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568600.808239:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae282044400, rc 0) 00000100:00100000:1.0:1788568600.808298:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+15:5838:x1875449976223360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568600.808305:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788568600.808387:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976223360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788568600.808415:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae27feab400/0x41e82f464b6a0d4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0d55 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568600.808427:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae27feab400/0x41e82f464b6a0d4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0d55 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568600.808497:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976223488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788568600.808529:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568600.808851:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae25042ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788568600.809243:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976223488 00000100:00100000:3.0:1788568600.809251:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976223488 00000100:00100000:3.0:1788568600.809288:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788568600.809297:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+15:5838:x1875449976223488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788568600.810317:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+15:5838:x1875449976223488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1016us (1781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568600.810329:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788568600.810437:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976223488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788568600.810499:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976223616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788568600.810556:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568600.810633:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae26fb73840 going to sleep for 11 seconds 00000100:00100000:1.0:1788568600.810699:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976223616 00000100:00100000:1.0:1788568600.810704:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976223616 00000100:00100000:1.0:1788568600.810775:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788568600.810784:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+15:5838:x1875449976223616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788568600.811479:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+15:5838:x1875449976223616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 692us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568600.811488:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788568600.811599:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976223616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788568600.812364:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c30a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:8469:1875449976223744:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788568600.812426:0:8469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568600.812504:0:8469:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae252512f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788568600.812540:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976223744 00000100:00100000:1.0:1788568600.812546:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976223744 00000100:00100000:1.0:1788568600.812614:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788568600.812624:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+15:8469:x1875449976223744:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788568600.813417:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+15:8469:x1875449976223744:12345-0@lo:502:llog_process_th.0 Request processed in 791us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568600.813425:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788568600.813574:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c30a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:8469:1875449976223744:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788568600.813652:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c30a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:8469:1875449976223872:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788568600.813694:0:8469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568600.813767:0:8469:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae252512f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788568600.813989:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976223872 00000100:00100000:1.0:1788568600.813996:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976223872 00000100:00100000:1.0:1788568600.814036:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788568600.814044:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+15:8469:x1875449976223872:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788568600.814260:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+15:8469:x1875449976223872:12345-0@lo:502:llog_process_th.0 Request processed in 216us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568600.814267:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788568600.819229:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c30a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:8469:1875449976223872:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788568600.819434:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788568600.819762:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788568600.819790:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788568600.819803:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae27feab400/0x41e82f464b6a0d4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0d55 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568600.819992:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae27feab400/0x41e82f464b6a0d4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0d55 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568600.820114:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788568600.820119:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1788568600.820123:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788568600.820176:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae27feaa600/0x41e82f464b6a0d5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568600.820191:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae27feaa600/0x41e82f464b6a0d5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568600.820903:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae27feaa600/0x41e82f464b6a0d5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568600.820969:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976224000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788568600.821172:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568600.821305:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae25042a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788568600.821518:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976224000 00000100:00100000:1.0:1788568600.821528:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976224000 00000100:00100000:1.0:1788568600.821650:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788568600.821663:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+15:5838:x1875449976224000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788568600.821680:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568600.821699:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae282045000/0x41e82f464b6a0d63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0d5c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568600.821730:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae282045000/0x41e82f464b6a0d63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0d5c expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568600.821743:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae282045000/0x41e82f464b6a0d63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0d5c expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568600.821755:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae282045000, rc 0) 00000100:00100000:1.0:1788568600.821809:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+16:5838:x1875449976224000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568600.821835:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788568600.821923:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976224000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788568600.821963:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae27feaa600/0x41e82f464b6a0d5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0d63 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568600.821973:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae27feaa600/0x41e82f464b6a0d5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0d63 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568600.822066:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976224128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788568600.822095:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568600.822124:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae25042a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788568600.822143:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976224128 00000100:00100000:1.0:1788568600.822147:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976224128 00000100:00100000:1.0:1788568600.822181:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788568600.822187:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+16:5838:x1875449976224128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788568600.822730:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+16:5838:x1875449976224128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 541us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568600.822739:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788568600.823041:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976224128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788568600.823092:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976224256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788568600.823141:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568600.823175:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae25042a900 going to sleep for 11 seconds 00000100:00100000:3.0:1788568600.823231:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976224256 00000100:00100000:3.0:1788568600.823238:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976224256 00000100:00100000:3.0:1788568600.823285:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788568600.823295:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+16:5838:x1875449976224256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788568600.824778:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+16:5838:x1875449976224256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1475us (1626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568600.824802:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788568600.825127:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976224256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788568600.825919:0:8470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:8470:1875449976224384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788568600.826032:0:8470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568600.826075:0:8470:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae26fb73d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788568600.826153:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976224384 00000100:00100000:1.0:1788568600.826161:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976224384 00000100:00100000:1.0:1788568600.826213:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788568600.826224:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+16:8470:x1875449976224384:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788568600.826504:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+16:8470:x1875449976224384:12345-0@lo:502:llog_process_th.0 Request processed in 280us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568600.826512:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788568600.826709:0:8470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:8470:1875449976224384:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788568600.826744:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788568600.826755:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788568600.826758:0:8470:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788568600.826765:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788568600.826799:0:8470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:8470:1875449976224512:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788568600.826841:0:8470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568600.826887:0:8470:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae248a96540 going to sleep for 11 seconds 00000100:00100000:1.0:1788568600.826960:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976224512 00000100:00100000:1.0:1788568600.826965:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976224512 00000100:00100000:1.0:1788568600.826994:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788568600.827002:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+16:8470:x1875449976224512:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788568600.827146:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+16:8470:x1875449976224512:12345-0@lo:502:llog_process_th.0 Request processed in 145us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568600.827154:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788568600.827528:0:8470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:8470:1875449976224512:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788568600.827556:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788568600.827570:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788568600.827573:0:8470:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788568600.827587:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1788568600.827679:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1788568600.827711:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788568600.827725:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae27feaa600/0x41e82f464b6a0d5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0d63 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568600.827739:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae27feaa600/0x41e82f464b6a0d5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0d63 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568600.827751:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788568600.827755:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ae26b352000 from 39 10000000:01000000:0.0:1788568600.827758:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788568600.827804:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae27feaaa00/0x41e82f464b6a0d6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568600.827813:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae27feaaa00/0x41e82f464b6a0d6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568600.827823:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae27feaaa00/0x41e82f464b6a0d6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568600.827842:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976224640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788568600.827896:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568600.827951:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae248a96900 going to sleep for 11 seconds 00000100:00100000:1.0:1788568600.829921:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976224640 00000100:00100000:1.0:1788568600.829957:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976224640 00000100:00100000:1.0:1788568600.830032:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788568600.830044:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+16:5838:x1875449976224640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788568600.830078:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568600.830100:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae282045e00/0x41e82f464b6a0d71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0d6a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568600.830135:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae282045e00/0x41e82f464b6a0d71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0d6a expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568600.830147:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae282045e00/0x41e82f464b6a0d71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0d6a expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568600.830158:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae282045e00, rc 0) 00000100:00100000:1.0:1788568600.830246:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+17:5838:x1875449976224640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 205us (2349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568600.830253:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788568600.830676:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976224640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788568600.830701:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae27feaaa00/0x41e82f464b6a0d6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0d71 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568600.830713:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae27feaaa00/0x41e82f464b6a0d6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0d71 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568600.830802:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26f93e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976224768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788568600.830846:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568600.830994:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae277da0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788568600.831209:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976224768 00000100:00100000:3.0:1788568600.831219:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976224768 00000100:00100000:3.0:1788568600.831271:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788568600.831281:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+17:5838:x1875449976224768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788568600.832857:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+17:5838:x1875449976224768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1561us (1993us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568600.832882:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788568600.833501:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26f93e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976224768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788568600.833572:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26f93e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976224896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788568600.833669:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568600.834031:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae277da0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788568600.834183:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976224896 00000100:00100000:2.0:1788568600.834192:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976224896 00000100:00100000:2.0:1788568600.834391:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788568600.834403:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+17:5838:x1875449976224896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788568600.835379:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+17:5838:x1875449976224896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 967us (1698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568600.835391:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788568600.835674:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26f93e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976224896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788568600.836251:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:8471:1875449976225024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788568600.836334:0:8471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568600.837578:0:8471:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae248a96300 going to sleep for 11 seconds 00000100:00100000:1.0:1788568600.837682:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976225024 00000100:00100000:1.0:1788568600.837693:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976225024 00000100:00100000:1.0:1788568600.837760:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788568600.837772:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+17:8471:x1875449976225024:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788568600.838357:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+17:8471:x1875449976225024:12345-0@lo:502:llog_process_th.0 Request processed in 585us (2020us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568600.838366:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788568600.838517:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:8471:1875449976225024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788568600.838591:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:8471:1875449976225152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788568600.838653:0:8471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568600.838675:0:8471:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae248a96300 going to sleep for 11 seconds 00000100:00100000:2.0:1788568600.838723:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976225152 00000100:00100000:2.0:1788568600.838729:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976225152 00000100:00100000:2.0:1788568600.838769:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788568600.838778:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae250449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+17:8471:x1875449976225152:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788568600.839269:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae250449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+17:8471:x1875449976225152:12345-0@lo:502:llog_process_th.0 Request processed in 492us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568600.839278:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788568600.839360:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:8471:1875449976225152:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788568600.839384:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788568600.839636:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788568600.839666:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788568600.839678:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae27feaaa00/0x41e82f464b6a0d6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0d71 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568600.839690:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae27feaaa00/0x41e82f464b6a0d6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0d71 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788568600.839711:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788568600.839714:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1788568600.839717:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788568600.839759:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b000/0x41e82f464b6a0d78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568600.839768:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b000/0x41e82f464b6a0d78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568600.839777:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b000/0x41e82f464b6a0d78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568600.839797:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976225280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788568600.840192:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568600.840227:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae26fb73900 going to sleep for 11 seconds 00000100:00100000:1.0:1788568600.840283:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976225280 00000100:00100000:1.0:1788568600.840290:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976225280 00000100:00100000:1.0:1788568600.840336:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788568600.840345:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae250449450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+17:5838:x1875449976225280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788568600.840357:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568600.840373:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae282045a00/0x41e82f464b6a0d7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0d78 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568600.840401:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae282045a00/0x41e82f464b6a0d7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0d78 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568600.840412:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae282045a00/0x41e82f464b6a0d7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0d78 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568600.840422:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae282045a00, rc 0) 00000100:00100000:1.0:1788568600.840469:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae250449450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+18:5838:x1875449976225280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568600.840475:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788568600.840580:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976225280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788568600.840596:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b000/0x41e82f464b6a0d78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0d7f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568600.840606:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b000/0x41e82f464b6a0d78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0d7f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568600.840671:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976225408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788568600.840699:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568600.840722:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae26fb73900 going to sleep for 11 seconds 00000100:00100000:1.0:1788568600.840833:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976225408 00000100:00100000:1.0:1788568600.840848:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976225408 00000100:00100000:1.0:1788568600.840920:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788568600.840957:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+18:5838:x1875449976225408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788568600.841270:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+18:5838:x1875449976225408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 341us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568600.841277:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788568600.841355:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976225408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788568600.841392:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976225536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788568600.841444:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568600.842265:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae26fb73900 going to sleep for 11 seconds 00000100:00100000:3.0:1788568600.842309:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976225536 00000100:00100000:3.0:1788568600.842317:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976225536 00000100:00100000:3.0:1788568600.842367:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788568600.842456:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+18:5838:x1875449976225536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788568600.842691:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+18:5838:x1875449976225536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 238us (1245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568600.842699:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788568600.843084:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976225536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788568600.843528:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:8472:1875449976225664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788568600.843597:0:8472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568600.843639:0:8472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae26fb73000 going to sleep for 11 seconds 00000100:00100000:0.0:1788568600.843712:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976225664 00000100:00100000:0.0:1788568600.843719:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976225664 00000100:00100000:0.0:1788568600.843768:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788568600.843777:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+18:8472:x1875449976225664:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788568600.844265:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+18:8472:x1875449976225664:12345-0@lo:502:llog_process_th.0 Request processed in 487us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568600.844274:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788568600.844593:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:8472:1875449976225664:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788568600.844629:0:8472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788568600.844640:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788568600.844643:0:8472:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788568600.844652:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788568600.844684:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:8472:1875449976225792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788568600.844730:0:8472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568600.845096:0:8472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae26fb73000 going to sleep for 11 seconds 00000100:00100000:1.0:1788568600.845212:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976225792 00000100:00100000:1.0:1788568600.845220:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976225792 00000100:00100000:0.0:1788568600.845275:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788568600.845286:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae250448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+18:8472:x1875449976225792:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788568600.845891:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae250448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+18:8472:x1875449976225792:12345-0@lo:502:llog_process_th.0 Request processed in 605us (1158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568600.846080:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788568600.846778:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:8472:1875449976225792:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788568600.846831:0:8472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788568600.846841:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788568600.846844:0:8472:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788568600.846852:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1788568600.847257:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1788568600.847280:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788568600.847294:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b000/0x41e82f464b6a0d78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0d7f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568600.847306:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b000/0x41e82f464b6a0d78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0d7f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788568600.847317:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788568600.847321:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ae26b2dcd40 from 1 10000000:01000000:3.0:1788568600.847325:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788568600.847378:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae2429dfa00/0x41e82f464b6a0d86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568600.847401:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae2429dfa00/0x41e82f464b6a0d86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568600.847412:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae2429dfa00/0x41e82f464b6a0d86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568600.847439:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976225920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788568600.847511:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568600.847779:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae252512a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788568600.848097:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976225920 00000100:00100000:0.0:1788568600.848106:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976225920 00000100:00100000:0.0:1788568600.848162:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788568600.848172:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae250448850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+18:5838:x1875449976225920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788568600.848186:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568600.848204:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae27feab200/0x41e82f464b6a0d8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0d86 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568600.848235:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae27feab200/0x41e82f464b6a0d8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0d86 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568600.848264:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae27feab200/0x41e82f464b6a0d8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0d86 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568600.848274:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae27feab200, rc 0) 00000100:00100000:0.0:1788568600.848337:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae250448850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+19:5838:x1875449976225920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568600.848345:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788568600.848493:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976225920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788568600.848510:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae2429dfa00/0x41e82f464b6a0d86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0d8d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568600.848521:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae2429dfa00/0x41e82f464b6a0d86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0d8d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568600.848597:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976226048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788568600.848633:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568600.848662:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae252512a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788568600.848776:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976226048 00000100:00100000:0.0:1788568600.848781:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976226048 00000100:00100000:0.0:1788568600.848799:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788568600.848805:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae250449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+19:5838:x1875449976226048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788568600.849487:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae250449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+19:5838:x1875449976226048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 678us (849us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788568600.849499:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788568600.849611:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976226048:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788568600.849652:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788568600.849660:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae2429dfa00/0x41e82f464b6a0d86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0d8d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568600.849671:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae2429dfa00/0x41e82f464b6a0d86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0d8d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568601.079563:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788568601.079595:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26f93f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976226176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788568601.079708:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568601.079846:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976226176 00000100:00100000:1.0:1788568601.079856:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976226176 00000100:00100000:1.0:1788568601.079956:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788568601.079968:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976226176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788568601.080013:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788568601.080077:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976226176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568601.080085:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788568601.080476:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae26f93f480 x1875449976226176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568617 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568601.080502:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26f93f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976226176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788568601.236612:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568601.236822:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958371968 00000100:00100000:0.0:1788568601.236836:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958371968 00000100:00100000:0.0:1788568601.236914:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 163 00000100:00100000:0.0:1788568601.236972:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+8:5603:x1875449958371968:12345-192.168.206.4@tcp:101: 00010000:00010000:0.0:1788568601.236994:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568601.237038:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae27feab800/0x41e82f464b6a0d94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bea00 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568601.237074:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae27feab800/0x41e82f464b6a0d94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea00 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568601.237087:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae27feab800/0x41e82f464b6a0d94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea00 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568601.237098:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae27feab800, rc 0) 00000100:00100000:0.0:1788568601.237182:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+9:5603:x1875449958371968:12345-192.168.206.4@tcp:101: Request processed in 257us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568601.237189:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 163 00000100:00100000:2.0:1788568601.247033:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568601.247181:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958372096 00000100:00100000:3.0:1788568601.247194:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958372096 00000100:00100000:3.0:1788568601.247268:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 164 00000100:00100000:3.0:1788568601.247290:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+9:5603:x1875449958372096:12345-192.168.206.4@tcp:501: 00000100:00100000:3.0:1788568601.248079:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+9:5603:x1875449958372096:12345-192.168.206.4@tcp:501: Request processed in 787us (1159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568601.248092:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 164 00000100:00100000:2.0:1788568601.259073:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568601.260183:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958372224 00000100:00100000:1.0:1788568601.260200:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958372224 00000100:00100000:1.0:1788568601.260279:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 165 00000100:00100000:1.0:1788568601.260292:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae250449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+9:5603:x1875449958372224:12345-192.168.206.4@tcp:503: 00000100:00100000:1.0:1788568601.262045:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae250449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+9:5603:x1875449958372224:12345-192.168.206.4@tcp:503: Request processed in 1739us (2970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568601.262062:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 165 00000100:00100000:1.0:1788568601.283411:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568601.287148:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958372352 00000100:00100000:0.0:1788568601.287172:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958372352 00000100:00100000:0.0:1788568601.287615:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 166 00000100:00100000:0.0:1788568601.287629:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+9:6081:x1875449958372352:12345-192.168.206.4@tcp:502: 00000100:00100000:0.0:1788568601.288103:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+9:6081:x1875449958372352:12345-192.168.206.4@tcp:502: Request processed in 475us (4703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568601.288112:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 166 00000100:00100000:2.0:1788568601.301745:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568601.308760:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958372480 00000100:00100000:1.0:1788568601.308782:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958372480 00000100:00100000:1.0:1788568601.308994:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 167 00000100:00100000:1.0:1788568601.309007:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae250448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+9:6081:x1875449958372480:12345-192.168.206.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788568601.309388:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae250448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+9:6081:x1875449958372480:12345-192.168.206.4@tcp:502:llog_process_th.0 Request processed in 383us (8084us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568601.309396:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 167 00000100:00100000:2.0:1788568601.323214:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568601.323626:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958372608 00000100:00100000:0.0:1788568601.323640:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958372608 00000100:00100000:0.0:1788568601.323709:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 168 00000100:00100000:0.0:1788568601.323721:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+9:5603:x1875449958372608:12345-192.168.206.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788568601.323743:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568601.323768:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae27feaba00/0x41e82f464b6a0d9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bea07 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568601.323829:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae27feaba00/0x41e82f464b6a0d9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea07 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568601.323841:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae27feaba00/0x41e82f464b6a0d9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea07 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568601.323851:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae27feaba00, rc 0) 00000100:00100000:0.0:1788568601.323970:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+10:5603:x1875449958372608:12345-192.168.206.4@tcp:101:ll_cfg_requeue.0 Request processed in 251us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568601.323978:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 168 00000100:00100000:0.0:1788568601.342806:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568601.343272:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958372736 00000100:00100000:1.0:1788568601.343289:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958372736 00000100:00100000:1.0:1788568601.343378:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 169 00000100:00100000:1.0:1788568601.343391:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae250448050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+10:5603:x1875449958372736:12345-192.168.206.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788568601.343778:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae250448050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+10:5603:x1875449958372736:12345-192.168.206.4@tcp:501:ll_cfg_requeue.0 Request processed in 388us (986us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788568601.343787:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 169 00010000:00010000:0.0:1788568601.784696:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788568602.316003:0:8509:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff80595500 20000000:00000080:2.0:1788568602.316032:0:8509:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ae27cd8b400 uarg=0000000000000000 20000000:01000000:2.0:1788568602.316081:0:8509:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788568602.316100:0:8509:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788568602.316106:0:8509:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788568602.317834:0:8510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1788568602.318451:0:8509:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1788568602.325278:0:8509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1788568602.325342:0:8509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1788568602.325480:0:8509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1788568602.325502:0:8509:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788568602.325526:0:8509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ae252e7b600/0x41e82f464b6a0da2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568602.325548:0:8509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae240031000/0x41e82f464b6a0b17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0b10 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568602.325556:0:8509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae240031e00/0x41e82f464b6a0b79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0b72 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568602.325563:0:8509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae282044800/0x41e82f464b6a0c44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0c3d expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568602.325574:0:8509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0d01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9be9cf expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568602.325582:0:8509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ae252e7b600/0x41e82f464b6a0da2 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568602.325634:0:8509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0d01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9be9cf expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568602.325766:0:8509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0d01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9be9cf expref: 9 pid: 5835 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568602.325881:0:8509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1875449976226304:192.168.206.4@tcp:104: 00010000:00010000:2.0:1788568602.326206:0:8509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae282044800/0x41e82f464b6a0c44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x41e82f464b6a0c3d expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568602.326216:0:8509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae282044800/0x41e82f464b6a0c44 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x41e82f464b6a0c3d expref: 18 pid: 5834 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568602.326226:0:8509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1875449976226432:0@lo:104: 00000100:00100000:2.0:1788568602.326271:0:8509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788568602.326319:0:8509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae240031e00/0x41e82f464b6a0b79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x41e82f464b6a0b72 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568602.326327:0:8509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae240031e00/0x41e82f464b6a0b79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x41e82f464b6a0b72 expref: 18 pid: 5836 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568602.326335:0:8509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1875449976226560:0@lo:104: 00000100:00100000:2.0:1788568602.326431:0:8509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788568602.326465:0:8509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae240031000/0x41e82f464b6a0b17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x41e82f464b6a0b10 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568602.326474:0:8509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae240031000/0x41e82f464b6a0b17 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x41e82f464b6a0b10 expref: 18 pid: 5836 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568602.326483:0:8509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1875449976226688:0@lo:104: 00000100:00100000:2.0:1788568602.326503:0:8509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae26fb73f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788568602.326747:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788568602.326769:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568602.326798:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976226432 00000100:00100000:0.0:1788568602.326807:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976226432 00000100:00100000:0.0:1788568602.326872:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976226560 00000100:00100000:0.0:1788568602.326875:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976226560 00000100:00100000:0.0:1788568602.326887:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976226688 00000100:00100000:0.0:1788568602.326889:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976226688 00000100:00100000:0.0:1788568602.326904:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788568602.326913:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:925db6b8-84bc-418c-b37a-40345c1020be+5:8509:x1875449976226432:12345-0@lo:104: 00010000:00010000:0.0:1788568602.327044:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.104@tcp lock: ffff9ae252e7be00/0x41e82f464b6a0c3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0c44 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568602.327168:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788568602.327176:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:925db6b8-84bc-418c-b37a-40345c1020be+5:8509:x1875449976226432:12345-0@lo:104: Request processed in 263us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568602.327197:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788568602.327217:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788568602.327223:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244811850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:925db6b8-84bc-418c-b37a-40345c1020be+4:8509:x1875449976226560:12345-0@lo:104: 00010000:00010000:0.0:1788568602.327231:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.104@tcp lock: ffff9ae240030000/0x41e82f464b6a0b72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0b79 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568602.327264:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788568602.327269:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244811850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:925db6b8-84bc-418c-b37a-40345c1020be+4:8509:x1875449976226560:12345-0@lo:104: Request processed in 47us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568602.327275:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788568602.327307:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788568602.327313:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fec6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:925db6b8-84bc-418c-b37a-40345c1020be+3:8509:x1875449976226688:12345-0@lo:104: 00010000:00010000:0.0:1788568602.327320:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b200/0x41e82f464b6a0b10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0b17 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568602.327346:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788568602.327351:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fec6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:925db6b8-84bc-418c-b37a-40345c1020be+3:8509:x1875449976226688:12345-0@lo:104: Request processed in 39us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568602.327356:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1788568602.327371:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788568602.327377:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae252e7be00/0x41e82f464b6a0c3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0c44 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568602.327385:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7be00 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:0.0:1788568602.327390:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae252e7be00/0x41e82f464b6a0c3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x41e82f464b6a0c44 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568602.327408:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae252e7be00/0x41e82f464b6a0c3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x41e82f464b6a0c44 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788568602.327417:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae252e7be00/0x41e82f464b6a0c3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x41e82f464b6a0c44 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568602.327423:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788568602.327453:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae252e7be00/0x41e82f464b6a0c3d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0c44 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568602.327459:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788568602.327479:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae252e7be00/0x41e82f464b6a0c3d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0c44 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568602.327486:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae252e7be00/0x41e82f464b6a0c3d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0c44 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568602.327501:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788568602.327504:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae240030000/0x41e82f464b6a0b72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0b79 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568602.327509:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae240030000 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:0.0:1788568602.327513:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae240030000/0x41e82f464b6a0b72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x41e82f464b6a0b79 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568602.327519:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae240030000/0x41e82f464b6a0b72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x41e82f464b6a0b79 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788568602.327525:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae240030000/0x41e82f464b6a0b72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x41e82f464b6a0b79 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568602.327535:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788568602.327547:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae240030000/0x41e82f464b6a0b72 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0b79 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568602.327553:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788568602.327564:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae240030000/0x41e82f464b6a0b72 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0b79 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568602.327571:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae240030000/0x41e82f464b6a0b72 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0b79 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568602.327581:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788568602.327583:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b200/0x41e82f464b6a0b10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0b17 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568602.327600:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7b200 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:0.0:1788568602.327603:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b200/0x41e82f464b6a0b10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x41e82f464b6a0b17 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568602.327610:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b200/0x41e82f464b6a0b10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x41e82f464b6a0b17 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788568602.327616:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b200/0x41e82f464b6a0b10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x41e82f464b6a0b17 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568602.327621:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788568602.327631:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b200/0x41e82f464b6a0b10 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0b17 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568602.327636:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788568602.327647:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b200/0x41e82f464b6a0b10 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0b17 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568602.327654:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b200/0x41e82f464b6a0b10 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0b17 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568602.327731:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568602.327733:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568602.327735:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568602.327743:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568602.327757:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925db6b8-84bc-418c-b37a-40345c1020be:3307:1875449976226816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788568602.327790:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568602.327837:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:925db6b8-84bc-418c-b37a-40345c1020be:3308:1875449976226944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788568602.327873:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568602.327893:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788568602.327899:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:925db6b8-84bc-418c-b37a-40345c1020be:3308:1875449976227072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788568602.327921:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568602.327973:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976226816 00000100:00100000:0.0:1788568602.327979:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976226816 00010000:00010000:0.0:1788568602.328001:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae282044800/0x41e82f464b6a0c44 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0c3d expref: 19 pid: 5834 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568602.328022:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976226944 00000100:00100000:0.0:1788568602.328024:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976226944 00010000:00010000:0.0:1788568602.328034:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae240031e00/0x41e82f464b6a0b79 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0b72 expref: 20 pid: 5836 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568602.328043:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976227072 00000100:00100000:0.0:1788568602.328045:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976227072 00010000:00010000:0.0:1788568602.328055:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae240031000/0x41e82f464b6a0b17 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0b10 expref: 21 pid: 5836 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568602.328076:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788568602.328082:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:925db6b8-84bc-418c-b37a-40345c1020be+21:3307:x1875449976226816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788568602.328094:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568602.328101:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae282044800/0x41e82f464b6a0c44 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0c3d expref: 21 pid: 5834 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568602.328112:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae282044800/0x41e82f464b6a0c44 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x41e82f464b6a0c3d expref: 21 pid: 5834 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568602.328131:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788568602.328161:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:925db6b8-84bc-418c-b37a-40345c1020be+21:3307:x1875449976226816:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568602.328167:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788568602.328183:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788568602.328189:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fec5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:925db6b8-84bc-418c-b37a-40345c1020be+20:3308:x1875449976226944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788568602.328197:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568602.328202:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae240031e00/0x41e82f464b6a0b79 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0b72 expref: 20 pid: 5836 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568602.328209:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae240031e00/0x41e82f464b6a0b79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x41e82f464b6a0b72 expref: 20 pid: 5836 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568602.328218:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788568602.328242:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fec5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:925db6b8-84bc-418c-b37a-40345c1020be+20:3308:x1875449976226944:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568602.328248:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788568602.328260:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788568602.328273:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:925db6b8-84bc-418c-b37a-40345c1020be+19:3308:x1875449976227072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788568602.328280:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568602.328285:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae240031000/0x41e82f464b6a0b17 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0b10 expref: 19 pid: 5836 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568602.328293:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae240031000/0x41e82f464b6a0b17 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x41e82f464b6a0b10 expref: 19 pid: 5836 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568602.328302:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788568602.328323:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:925db6b8-84bc-418c-b37a-40345c1020be+19:3308:x1875449976227072:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568602.328329:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788568602.328376:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925db6b8-84bc-418c-b37a-40345c1020be:3307:1875449976226816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788568602.328403:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:925db6b8-84bc-418c-b37a-40345c1020be:3308:1875449976227072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788568602.328410:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:925db6b8-84bc-418c-b37a-40345c1020be:3308:1875449976226944:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788568602.329256:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae282044800/0x41e82f464b6a0c44 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x41e82f464b6a0c3d expref: 18 pid: 5834 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568602.329276:0:8509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1875449976226432:0@lo:104: 00010000:00010000:1.0:1788568602.329294:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568602.329311:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae240031e00/0x41e82f464b6a0b79 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x41e82f464b6a0b72 expref: 17 pid: 5836 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568602.329321:0:8509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1875449976226560:0@lo:104: 00010000:00010000:1.0:1788568602.329331:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae240031000/0x41e82f464b6a0b17 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x41e82f464b6a0b10 expref: 16 pid: 5836 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568602.329339:0:8509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1875449976226688:0@lo:104: 00000100:00100000:1.0:1788568602.331348:0:8509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1875449976226304:192.168.206.4@tcp:104: 00000100:00100000:0.0:1788568602.331348:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00010000:00010000:1.0:1788568602.331410:0:8509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ae252e7b600/0x41e82f464b6a0da2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568602.331423:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958372864 00000100:00100000:2.0:1788568602.331432:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958372864 00010000:00010000:2.0:1788568602.331475:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0d01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9be9cf expref: 10 pid: 5835 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568602.331520:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 24 00000100:00100000:2.0:1788568602.331538:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fec5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f0f084e-5158-464d-a770-11379825208e+10:2364:x1875449958372864:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788568602.331557:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568602.331563:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0d01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9be9cf expref: 10 pid: 5835 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568602.331575:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0d01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9be9cf expref: 10 pid: 5835 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568602.331607:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0d01 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9be9cf expref: 10 pid: 5835 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568602.331628:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ae252e7b600/0x41e82f464b6a0da2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568602.331638:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae252e7b600/0x41e82f464b6a0da2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568602.331656:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae252e7b600/0x41e82f464b6a0da2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568602.331758:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae252e7b600/0x41e82f464b6a0da2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568602.331767:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ae252e7b600/0x41e82f464b6a0da2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568602.331775:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ae252e7b600/0x41e82f464b6a0da2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568602.331782:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7b600 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:2.0:1788568602.331787:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ae252e7b600/0x41e82f464b6a0da2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568602.331804:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ae252e7b600/0x41e82f464b6a0da2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568602.331825:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ae252e7b600/0x41e82f464b6a0da2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568602.331835:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568602.331915:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fec5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f0f084e-5158-464d-a770-11379825208e+9:2364:x1875449958372864:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 378us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568602.331954:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 24 00010000:00010000:1.0:1788568602.332090:0:8509:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ae252e7b600/0x41e82f464b6a0da2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568602.332099:0:8509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ae252e7b600/0x41e82f464b6a0da2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568602.332107:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae252e7b600/0x41e82f464b6a0da2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568602.810829:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568602.899009:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568602.899076:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958372992 00000100:00100000:3.0:1788568602.899093:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958372992 00000100:00100000:3.0:1788568602.899178:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 170 00000100:00100000:3.0:1788568602.899191:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+9:5603:x1875449958372992:12345-192.168.206.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788568602.899213:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568602.899240:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae2429de800/0x41e82f464b6a0da9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bea0e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568602.899668:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae2429de800/0x41e82f464b6a0da9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea0e expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568602.899683:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae2429de800/0x41e82f464b6a0da9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea0e expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568602.899693:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429de800, rc 0) 00000100:00100000:3.0:1788568602.899780:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+10:5603:x1875449958372992:12345-192.168.206.4@tcp:101:ll_cfg_requeue.0 Request processed in 591us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568602.899789:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 170 00000100:00100000:2.0:1788568602.907919:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568602.908067:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958373120 00000100:00100000:3.0:1788568602.908089:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958373120 00000100:00100000:3.0:1788568602.908165:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 171 00000100:00100000:3.0:1788568602.908179:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+10:5603:x1875449958373120:12345-192.168.206.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788568602.908591:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+10:5603:x1875449958373120:12345-192.168.206.4@tcp:501:ll_cfg_requeue.0 Request processed in 413us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568602.908601:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 171 00000100:00100000:2.0:1788568602.915531:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568602.918174:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958373248 00000100:00100000:0.0:1788568602.918194:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958373248 00000100:00100000:0.0:1788568602.918268:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 172 00000100:00100000:0.0:1788568602.918281:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+10:5603:x1875449958373248:12345-192.168.206.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788568602.918555:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+10:5603:x1875449958373248:12345-192.168.206.4@tcp:503:ll_cfg_requeue.0 Request processed in 275us (3039us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568602.918564:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 172 00000100:00100000:0.0:1788568602.924046:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568602.924214:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958373376 00000100:00100000:2.0:1788568602.924228:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958373376 00000100:00100000:2.0:1788568602.924314:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 173 00000100:00100000:2.0:1788568602.924326:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+10:6133:x1875449958373376:12345-192.168.206.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788568602.924635:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+10:6133:x1875449958373376:12345-192.168.206.4@tcp:502:llog_process_th.0 Request processed in 310us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568602.924644:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 173 00000100:00100000:2.0:1788568602.956422:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568602.957139:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958373504 00000100:00100000:0.0:1788568602.957159:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958373504 00000100:00100000:0.0:1788568602.957235:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 174 00000100:00100000:0.0:1788568602.957249:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+10:6133:x1875449958373504:12345-192.168.206.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788568602.957560:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+10:6133:x1875449958373504:12345-192.168.206.4@tcp:502:llog_process_th.0 Request processed in 312us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568602.957569:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 174 10000000:01000000:3.0:1788568603.383036:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788568603.383046:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae277b92800 from 4 10000000:01000000:3.0:1788568603.383052:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788568603.383113:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae2429de600/0x41e82f464b6a0db0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568603.383127:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae2429de600/0x41e82f464b6a0db0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568603.383141:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae2429de600/0x41e82f464b6a0db0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568603.383173:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976227200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788568603.383269:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568603.383335:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae25315c840 going to sleep for 11 seconds 00000100:00100000:1.0:1788568603.383500:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976227200 00000100:00100000:1.0:1788568603.383512:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976227200 00000100:00100000:1.0:1788568603.383647:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788568603.383662:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+16:5838:x1875449976227200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788568603.383679:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568603.383697:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae282045600/0x41e82f464b6a0db7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0db0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568603.383729:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae282045600/0x41e82f464b6a0db7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0db0 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568603.383743:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae282045600/0x41e82f464b6a0db7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0db0 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568603.383753:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae282045600, rc 0) 00000100:00100000:1.0:1788568603.383863:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+17:5838:x1875449976227200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 193us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568603.383871:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788568603.389259:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976227200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788568603.389299:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae2429de600/0x41e82f464b6a0db0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0db7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568603.389315:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae2429de600/0x41e82f464b6a0db0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0db7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568603.389435:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976227328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788568603.389525:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568603.389593:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae141c426c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788568603.389654:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976227328 00000100:00100000:1.0:1788568603.389664:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976227328 00000100:00100000:1.0:1788568603.389723:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788568603.389735:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+17:5838:x1875449976227328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788568603.390117:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+17:5838:x1875449976227328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 384us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568603.390125:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788568603.390413:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976227328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788568603.390473:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976227456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788568603.390524:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568603.390557:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae141c426c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788568603.390655:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976227456 00000100:00100000:3.0:1788568603.390662:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976227456 00000100:00100000:3.0:1788568603.390706:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788568603.390718:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+17:5838:x1875449976227456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788568603.390984:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+17:5838:x1875449976227456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 268us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568603.390992:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788568603.391304:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976227456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788568603.391678:0:8540:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:8540:1875449976227584:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788568603.391736:0:8540:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568603.391785:0:8540:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae141c42cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788568603.391902:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976227584 00000100:00100000:1.0:1788568603.391907:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976227584 00000100:00100000:1.0:1788568603.391993:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788568603.392003:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+17:8540:x1875449976227584:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788568603.392220:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+17:8540:x1875449976227584:12345-0@lo:502:llog_process_th.0 Request processed in 218us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568603.392228:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788568603.392385:0:8540:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:8540:1875449976227584:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788568603.392415:0:8540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788568603.392428:0:8540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788568603.392431:0:8540:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788568603.392444:0:8540:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ae277b92800 00000020:00000080:0.0:1788568603.392447:0:8540:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788568603.392577:0:8540:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:8540:1875449976227712:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788568603.392622:0:8540:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568603.392652:0:8540:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae141c42cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788568603.393876:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976227712 00000100:00100000:1.0:1788568603.393888:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976227712 00000100:00100000:1.0:1788568603.393964:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788568603.393975:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+17:8540:x1875449976227712:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788568603.394246:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+17:8540:x1875449976227712:12345-0@lo:502:llog_process_th.0 Request processed in 272us (1622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568603.394254:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788568603.397620:0:8540:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:8540:1875449976227712:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788568603.397677:0:8540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788568603.397688:0:8540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788568603.397691:0:8540:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788568603.397702:0:8540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788568603.398001:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788568603.398029:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788568603.398041:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae2429de600/0x41e82f464b6a0db0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0db7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568603.398054:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae2429de600/0x41e82f464b6a0db0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0db7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568603.398068:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788568603.398071:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae27bf74800 from 4 10000000:01000000:0.0:1788568603.398074:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788568603.398122:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae27feab600/0x41e82f464b6a0dbe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568603.398131:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae27feab600/0x41e82f464b6a0dbe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568603.398150:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae27feab600/0x41e82f464b6a0dbe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568603.398177:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976227840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788568603.398251:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568603.398295:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae141c42cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788568603.398317:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976227840 00000100:00100000:0.0:1788568603.398323:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976227840 00000100:00100000:0.0:1788568603.398373:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788568603.398384:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+17:5838:x1875449976227840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788568603.398400:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568603.398416:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae27feaa200/0x41e82f464b6a0dc5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0dbe expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568603.398446:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae27feaa200/0x41e82f464b6a0dc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0dbe expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568603.398458:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae27feaa200/0x41e82f464b6a0dc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0dbe expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568603.398468:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae27feaa200, rc 0) 00000100:00100000:0.0:1788568603.398508:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+18:5838:x1875449976227840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568603.398516:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788568603.398565:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976227840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788568603.398590:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae27feab600/0x41e82f464b6a0dbe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0dc5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568603.398607:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae27feab600/0x41e82f464b6a0dbe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0dc5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568603.398657:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976227968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788568603.398682:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568603.398696:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae141c42cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788568603.398708:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976227968 00000100:00100000:0.0:1788568603.398710:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976227968 00000100:00100000:0.0:1788568603.398731:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788568603.398736:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+18:5838:x1875449976227968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788568603.399050:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+18:5838:x1875449976227968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 311us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568603.399057:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788568603.399085:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976227968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788568603.399109:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976228096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788568603.399147:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568603.399164:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae141c42cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788568603.399174:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976228096 00000100:00100000:0.0:1788568603.399177:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976228096 00000100:00100000:0.0:1788568603.399197:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788568603.399203:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+18:5838:x1875449976228096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788568603.399350:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+18:5838:x1875449976228096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568603.399357:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788568603.399403:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976228096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788568603.399603:0:8542:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:8542:1875449976228224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788568603.399637:0:8542:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568603.399656:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976228224 00000100:00100000:0.0:1788568603.399660:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976228224 00000100:00100000:0.0:1788568603.399681:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788568603.399688:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+18:8542:x1875449976228224:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788568603.399819:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+18:8542:x1875449976228224:12345-0@lo:502:llog_process_th.0 Request processed in 131us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568603.399826:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788568603.399868:0:8542:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae141c42a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788568603.399881:0:8542:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:8542:1875449976228224:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788568603.399902:0:8542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788568603.399913:0:8542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788568603.399916:0:8542:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788568603.399954:0:8542:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ae27bf74800 00000020:00000080:0.0:1788568603.399957:0:8542:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788568603.406044:0:8542:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:8542:1875449976228352:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788568603.406154:0:8542:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568603.406197:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976228352 00000100:00100000:0.0:1788568603.406204:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976228352 00000100:00100000:0.0:1788568603.406254:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788568603.406263:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+18:8542:x1875449976228352:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788568603.406522:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+18:8542:x1875449976228352:12345-0@lo:502:llog_process_th.0 Request processed in 259us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568603.406530:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788568603.406603:0:8542:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae141c42a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788568603.407749:0:8542:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:8542:1875449976228352:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788568603.407794:0:8542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788568603.407803:0:8542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788568603.407806:0:8542:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788568603.407815:0:8542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788568603.407890:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788568603.407907:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788568603.407919:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae27feab600/0x41e82f464b6a0dbe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0dc5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568603.407948:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae27feab600/0x41e82f464b6a0dbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0dc5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568603.407961:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788568603.407963:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae26b352000 from 4 10000000:01000000:0.0:1788568603.407966:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788568603.408005:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae27feaa000/0x41e82f464b6a0dcc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568603.408014:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae27feaa000/0x41e82f464b6a0dcc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568603.408024:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae27feaa000/0x41e82f464b6a0dcc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568603.408048:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976228480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788568603.408110:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568603.408149:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae141c42a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788568603.408169:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976228480 00000100:00100000:0.0:1788568603.408182:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976228480 00000100:00100000:0.0:1788568603.408226:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788568603.408235:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+18:5838:x1875449976228480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788568603.408250:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568603.408265:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae27feabc00/0x41e82f464b6a0dd3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0dcc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568603.408293:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae27feabc00/0x41e82f464b6a0dd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0dcc expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568603.408304:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae27feabc00/0x41e82f464b6a0dd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0dcc expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568603.408313:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae27feabc00, rc 0) 00000100:00100000:0.0:1788568603.408348:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+19:5838:x1875449976228480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568603.408355:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788568603.408401:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976228480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788568603.408414:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae27feaa000/0x41e82f464b6a0dcc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0dd3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568603.408424:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae27feaa000/0x41e82f464b6a0dcc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0dd3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568603.408475:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976228608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788568603.408500:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568603.408514:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae141c42a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788568603.408527:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976228608 00000100:00100000:0.0:1788568603.408539:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976228608 00000100:00100000:0.0:1788568603.408565:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788568603.408572:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae266991850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+19:5838:x1875449976228608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788568603.408967:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae266991850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+19:5838:x1875449976228608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 394us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568603.408975:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788568603.409011:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976228608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788568603.409044:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976228736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788568603.409086:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568603.409108:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae141c42a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788568603.409122:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976228736 00000100:00100000:0.0:1788568603.409125:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976228736 00000100:00100000:0.0:1788568603.409148:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788568603.409155:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae266992450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+19:5838:x1875449976228736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788568603.409304:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae266992450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+19:5838:x1875449976228736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568603.409312:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788568603.409353:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976228736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788568603.410965:0:8544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26f93e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:8544:1875449976228864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788568603.411054:0:8544:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568603.411101:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976228864 00000100:00100000:1.0:1788568603.411109:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976228864 00000100:00100000:1.0:1788568603.411157:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788568603.411166:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae252782850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+19:8544:x1875449976228864:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788568603.411414:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae252782850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+19:8544:x1875449976228864:12345-0@lo:502:llog_process_th.0 Request processed in 248us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568603.411423:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788568603.411483:0:8544:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae252739e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788568603.411510:0:8544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26f93e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:8544:1875449976228864:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788568603.411543:0:8544:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788568603.411554:0:8544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568603.411557:0:8544:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788568603.411565:0:8544:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ae26b352000 00000020:00000080:1.0:1788568603.411567:0:8544:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788568603.414846:0:8544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26f93e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:8544:1875449976228992:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788568603.414987:0:8544:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568603.415034:0:8544:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae252739e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788568603.415815:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976228992 00000100:00100000:0.0:1788568603.415830:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976228992 00000100:00100000:0.0:1788568603.415909:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788568603.415920:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae252783850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+19:8544:x1875449976228992:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788568603.416229:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae252783850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+19:8544:x1875449976228992:12345-0@lo:502:llog_process_th.0 Request processed in 309us (1241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568603.416239:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788568603.416911:0:8544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26f93e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:8544:1875449976228992:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788568603.416977:0:8544:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788568603.416987:0:8544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568603.416989:0:8544:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788568603.416995:0:8544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788568603.417200:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788568603.417229:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788568603.417242:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae27feaa000/0x41e82f464b6a0dcc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0dd3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568603.417255:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae27feaa000/0x41e82f464b6a0dcc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0dd3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568603.831583:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568604.180535:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568604.180617:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568604.180655:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568604.180683:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568604.180714:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958373760 00000100:00100000:2.0:1788568604.180725:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958373760 00000100:00100000:2.0:1788568604.180802:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 31 00000100:00100000:2.0:1788568604.180814:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2363:x1875449958373760:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:0.0:1788568604.180921:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958373888 00000100:00100000:0.0:1788568604.180945:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958373888 00000100:00100000:0.0:1788568604.180979:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958374016 00000100:00100000:0.0:1788568604.180982:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958374016 00000100:00100000:0.0:1788568604.181014:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 16 00000100:00100000:0.0:1788568604.181023:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2363:x1875449958373888:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:0.0:1788568604.181118:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2363:x1875449958373888:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 95us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568604.181126:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 16 00000100:00100000:0.0:1788568604.181147:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 17 00000100:00100000:0.0:1788568604.181154:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2363:x1875449958374016:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:0.0:1788568604.181182:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2363:x1875449958374016:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 29us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568604.181189:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 17 00000100:00100000:2.0:1788568604.181404:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2363:x1875449958373760:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 477us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568604.181415:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 31 00000100:00080000:2.0:1788568604.181442:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788568604.181447:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788568604.181451:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788568604.187997:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958373632 00000100:00100000:1.0:1788568604.188017:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958373632 00000100:00100000:1.0:1788568604.188087:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 190 00000100:00100000:1.0:1788568604.188100:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae252780c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+10:2363:x1875449958373632:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:1.0:1788568604.188208:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae252780c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+10:2363:x1875449958373632:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 111us (7688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568604.188216:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 190 00010000:00010000:0.0:1788568604.862007:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568605.175332:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976229504:0@lo:400:kworker.0 00000100:00100000:3.0:1788568605.175444:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568605.175499:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976229376:0@lo:400:kworker.0 00000100:00100000:2.0:1788568605.175543:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568605.175607:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976229376 00000100:00100000:2.0:1788568605.175616:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976229376 00000100:00100000:0.0:1788568605.175648:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976229120:0@lo:400:kworker.0 00000100:00100000:2.0:1788568605.175690:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788568605.175703:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cce5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976229376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568605.175710:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568605.175740:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875449976229632:0@lo:400:kworker.0 00000100:00100000:2.0:1788568605.175772:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cce5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976229376:12345-0@lo:400:kworker.0 Request processed in 71us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568605.175780:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568605.175787:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788568605.175807:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976229632 00000100:00100000:0.0:1788568605.175810:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788568605.175811:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976229632 00000100:00100000:0.0:1788568605.175830:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976229248:0@lo:400:kworker.0 00000100:00100000:2.0:1788568605.175841:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788568605.175872:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568605.175880:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fec4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875449976229632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568605.175890:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976229760:0@lo:400:kworker.0 00000100:00100000:2.0:1788568605.175921:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fec4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875449976229632:12345-0@lo:400:kworker.0 Request processed in 44us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568605.175950:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788568605.175954:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568605.175963:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976229248 00000100:00100000:2.0:1788568605.175968:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976229248 00000100:00100000:2.0:1788568605.175987:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788568605.175994:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976229248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568605.176005:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875449976229632:0@lo:400:kworker.0 00000100:00100000:2.0:1788568605.176024:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976229248:12345-0@lo:400:kworker.0 Request processed in 29us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568605.176042:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788568605.176048:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976229248:0@lo:400:kworker.0 00000100:00100000:2.0:1788568605.176078:0:8111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976229504 00000100:00100000:0.0:1788568605.176079:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976229760 00000100:00100000:2.0:1788568605.176082:0:8111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976229504 00000100:00100000:0.0:1788568605.176085:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976229760 00000100:00100000:2.0:1788568605.176116:0:8111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788568605.176125:0:8111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976229504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568605.176131:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788568605.176143:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976229760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568605.176168:0:8111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976229504:12345-0@lo:400:kworker.0 Request processed in 44us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568605.176176:0:8111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788568605.176195:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976229760:12345-0@lo:400:kworker.0 Request processed in 54us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568605.176202:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788568605.176213:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976229376:0@lo:400:kworker.0 00010000:00080000:2.0:1788568605.176243:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae141c32d80 x1875449976229504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568605.176254:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976229504:0@lo:400:kworker.0 00010000:00080000:0.0:1788568605.176532:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae141c31500 x1875449976229760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568605.176543:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976229760:0@lo:400:kworker.0 00000100:00080000:3.0:1788568605.176815:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788568605.176820:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788568605.176823:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788568605.176906:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976229120 00000100:00100000:1.0:1788568605.176921:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976229120 00000100:00100000:1.0:1788568605.176983:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788568605.176993:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae252780850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+19:3306:x1875449976229120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568605.177058:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae252780850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+19:3306:x1875449976229120:12345-0@lo:400:kworker.0 Request processed in 67us (1353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568605.177066:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788568605.177234:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976229120:0@lo:400:kworker.0 00000100:00100000:3.0:1788568605.687238:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788568605.687271:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976229888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788568605.687367:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568605.687524:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976229888 00000100:00100000:1.0:1788568605.687535:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976229888 00000100:00100000:1.0:1788568605.687601:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788568605.687613:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976229888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788568605.687667:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788568605.687729:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976229888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568605.687737:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788568605.688056:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae27fec5f80 x1875449976229888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568621 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568605.688082:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976229888:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788568605.884610:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568606.210573:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788568606.210595:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976230016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788568606.210674:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568606.210762:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976230016 00000100:00100000:0.0:1788568606.210770:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976230016 00000100:00100000:0.0:1788568606.210813:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788568606.210820:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976230016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788568606.210863:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788568606.210909:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976230016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568606.210944:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1788568606.210984:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae27fec5f80 x1875449976230016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568622 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568606.211003:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976230016:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788568606.904006:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568607.927881:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568608.951136:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788568609.254978:0:8808:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg604-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:2.0:1788568609.298899:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568609.298969:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568609.299011:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568609.299038:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568609.299066:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958374272 00000100:00100000:2.0:1788568609.299075:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958374272 00000100:00100000:2.0:1788568609.299131:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 35 00000100:00100000:2.0:1788568609.299141:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2363:x1875449958374272:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:2.0:1788568609.299210:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2363:x1875449958374272:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 70us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568609.299217:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 35 00000100:00100000:1.0:1788568609.299334:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958374144 00000100:00100000:1.0:1788568609.299339:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958374144 00000100:00100000:1.0:1788568609.299366:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 192 00000100:00100000:1.0:1788568609.299374:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+10:2363:x1875449958374144:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:1.0:1788568609.299399:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+10:2363:x1875449958374144:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 26us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568609.299406:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 192 00000100:00100000:2.0:1788568609.299459:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958374400 00000100:00100000:2.0:1788568609.299463:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958374400 00000100:00100000:2.0:1788568609.299495:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958374528 00000100:00100000:2.0:1788568609.299498:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958374528 00000100:00100000:2.0:1788568609.299519:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 20 00000100:00100000:2.0:1788568609.299526:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cce7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2363:x1875449958374400:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:2.0:1788568609.299554:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cce7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2363:x1875449958374400:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 28us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568609.299560:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 20 00000100:00100000:2.0:1788568609.299572:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 21 00000100:00100000:2.0:1788568609.299578:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2363:x1875449958374528:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:2.0:1788568609.299601:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2363:x1875449958374528:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 23us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568609.299606:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 21 00000100:00080000:2.0:1788568609.299620:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788568609.299624:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788568609.299626:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788568609.976168:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568610.296452:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b564700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875449976230272:0@lo:400:kworker.0 00000100:00100000:2.0:1788568610.296521:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568610.296571:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b564e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976230784:0@lo:400:kworker.0 00000100:00100000:2.0:1788568610.296599:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568610.296631:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788568610.296637:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b565500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925db6b8-84bc-418c-b37a-40345c1020be:3307:1875449976230144:0@lo:400:kworker.0 00000100:00100000:2.0:1788568610.296665:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568610.296685:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b565c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875449976230656:0@lo:400:kworker.0 00000100:00100000:2.0:1788568610.296705:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568610.296743:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976230400:0@lo:400:kworker.0 00000100:00100000:2.0:1788568610.296766:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568610.296785:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788568610.296790:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b565880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976230528:0@lo:400:kworker.0 00000100:00100000:2.0:1788568610.296810:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568610.296853:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976230272 00000100:00100000:2.0:1788568610.296860:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976230272 00000100:00100000:2.0:1788568610.296898:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976230656 00000100:00100000:2.0:1788568610.296900:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976230656 00000100:00100000:2.0:1788568610.296919:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976230400 00000100:00100000:2.0:1788568610.296922:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976230400 00000100:00100000:2.0:1788568610.296960:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788568610.296969:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b566a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875449976230272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568610.297019:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b566a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875449976230272:12345-0@lo:400:kworker.0 Request processed in 50us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568610.297027:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788568610.297045:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788568610.297051:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875449976230656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568610.297087:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875449976230656:12345-0@lo:400:kworker.0 Request processed in 36us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568610.297095:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788568610.297107:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788568610.297114:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b566d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976230400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568610.297154:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b566d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976230400:12345-0@lo:400:kworker.0 Request processed in 41us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568610.297160:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788568610.297180:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976230784 00000100:00100000:2.0:1788568610.297183:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976230784 00000100:00100000:2.0:1788568610.297208:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976230528 00000100:00100000:2.0:1788568610.297211:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976230528 00000100:00100000:2.0:1788568610.297231:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788568610.297238:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b567800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976230784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568610.297269:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b567800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976230784:12345-0@lo:400:kworker.0 Request processed in 31us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568610.297274:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788568610.297286:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788568610.297292:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b564a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976230528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568610.297318:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b564a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976230528:12345-0@lo:400:kworker.0 Request processed in 27us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568610.297323:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788568610.297348:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976230144 00000100:00100000:2.0:1788568610.297351:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976230144 00000100:00100000:2.0:1788568610.297377:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788568610.297384:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+19:3307:x1875449976230144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568610.297429:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+19:3307:x1875449976230144:12345-0@lo:400:kworker.0 Request processed in 45us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568610.297435:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00080000:2.0:1788568610.297476:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788568610.297480:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788568610.297482:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788568610.297514:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b565500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925db6b8-84bc-418c-b37a-40345c1020be:3307:1875449976230144:0@lo:400:kworker.0 00000100:00100000:2.0:1788568610.297529:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b565c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875449976230656:0@lo:400:kworker.0 00000100:00100000:2.0:1788568610.297539:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b564700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875449976230272:0@lo:400:kworker.0 00010000:00080000:2.0:1788568610.297552:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae27b564e00 x1875449976230784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568610.297562:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b564e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976230784:0@lo:400:kworker.0 00010000:00080000:0.0:1788568610.297644:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae27b565880 x1875449976230528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568610.297654:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b565880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976230528:0@lo:400:kworker.0 00000100:00100000:0.0:1788568610.297664:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976230400:0@lo:400:kworker.0 00000100:00100000:3.0:1788568610.812803:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b564e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976230912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788568610.812880:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568610.813000:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976230912 00000100:00100000:1.0:1788568610.813007:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976230912 00000100:00100000:1.0:1788568610.813053:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788568610.813062:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976230912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788568610.813104:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788568610.822670:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976230912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9601us (9781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568610.822685:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788568610.832982:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae27b564e00 x1875449976230912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568626 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568610.833009:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b564e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976230912:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788568610.999112:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568611.319268:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788568611.319300:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976231040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788568611.319374:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568611.319533:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976231040 00000100:00100000:1.0:1788568611.319541:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976231040 00000100:00100000:1.0:1788568611.319595:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788568611.319606:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976231040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788568611.319640:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788568611.319690:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976231040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568611.319697:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1788568611.319776:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae27fec5f80 x1875449976231040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568627 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568611.319795:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976231040:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788568612.025079:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568613.049912:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568614.071493:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568614.426106:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568614.427185:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568614.427216:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568614.427244:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568614.427293:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958374912 00000100:00100000:2.0:1788568614.427302:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958374912 00000100:00100000:2.0:1788568614.427353:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958375040 00000100:00100000:2.0:1788568614.427357:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958375040 00000100:00100000:2.0:1788568614.427379:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 10 00000100:00100000:2.0:1788568614.427388:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b565c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2360:x1875449958374912:12345-192.168.206.4@tcp:9:kworker.0 00000020:00000080:2.0:1788568614.427422:0:6690:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x41e82f464b6a0d0f 00000100:00080000:2.0:1788568614.427432:0:6690:0:(import.c:65:import_set_state_nolock()) ffff9ae27ff26800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788568614.427484:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788568614.427978:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b565c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+2:2360:x1875449958374912:12345-192.168.206.4@tcp:9:kworker.0 Request processed in 588us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568614.427987:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 10 00000100:00100000:0.0:1788568614.429305:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958374784 00000100:00100000:0.0:1788568614.429319:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958374784 00000100:00100000:0.0:1788568614.429413:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 39 00000100:00100000:0.0:1788568614.429422:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b564700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2363:x1875449958374784:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:0.0:1788568614.429489:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b564700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2363:x1875449958374784:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 68us (2310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568614.429496:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 39 00000100:00100000:2.0:1788568614.430097:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 11 00000100:00100000:2.0:1788568614.430109:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b565500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2360:x1875449958375040:12345-192.168.206.4@tcp:9:kworker.0 00000020:00000080:2.0:1788568614.430134:0:6690:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x41e82f464b6a0d16 00000100:00080000:2.0:1788568614.430145:0:6690:0:(import.c:65:import_set_state_nolock()) ffff9ae27bed8000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788568614.430185:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788568614.430485:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b565500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+2:2360:x1875449958375040:12345-192.168.206.4@tcp:9:kworker.0 Request processed in 378us (3238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568614.430492:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 11 00000100:00080000:2.0:1788568614.430520:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788568614.430524:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788568614.430526:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788568614.430588:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568614.432887:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958374656 00000100:00100000:1.0:1788568614.432900:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958374656 00000100:00100000:1.0:1788568614.432973:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 194 00000100:00100000:1.0:1788568614.432983:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+10:2363:x1875449958374656:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:1.0:1788568614.433053:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+10:2363:x1875449958374656:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 71us (6958us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568614.433061:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 194 00010000:00010000:0.0:1788568614.433744:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788568615.068778:0:9053:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg604-server.virtnet: executing yml_node 00010000:00010000:1.0:1788568615.096658:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568615.419478:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875449976231296:0@lo:400:kworker.0 00000100:00100000:0.0:1788568615.419611:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568615.419655:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976231808:0@lo:400:kworker.0 00000100:00100000:0.0:1788568615.419678:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568615.419709:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788568615.419715:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925db6b8-84bc-418c-b37a-40345c1020be:3307:1875449976231168:0@lo:400:kworker.0 00000100:00100000:0.0:1788568615.419752:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568615.419890:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875449976231680:0@lo:400:kworker.0 00000100:00100000:0.0:1788568615.419913:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568615.420009:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976231424:0@lo:400:kworker.0 00000100:00100000:0.0:1788568615.420045:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568615.420174:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788568615.420181:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976231552:0@lo:400:kworker.0 00000100:00100000:0.0:1788568615.420206:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568615.420235:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976231808 00000100:00100000:0.0:1788568615.420242:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976231808 00000100:00100000:0.0:1788568615.420291:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976231552 00000100:00100000:0.0:1788568615.420295:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976231552 00000100:00100000:0.0:1788568615.420317:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788568615.420325:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976231808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568615.420374:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976231808:12345-0@lo:400:kworker.0 Request processed in 50us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568615.420381:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788568615.420397:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788568615.420403:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae14350e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976231552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568615.420436:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae14350e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976231552:12345-0@lo:400:kworker.0 Request processed in 33us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568615.420442:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788568615.420459:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976231168 00000100:00100000:0.0:1788568615.420463:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976231168 00000100:00100000:2.0:1788568615.420575:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976231296 00000100:00100000:2.0:1788568615.420580:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976231296 00000100:00100000:2.0:1788568615.420609:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976231680 00000100:00100000:2.0:1788568615.420612:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976231680 00000100:00100000:2.0:1788568615.420625:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976231424 00000100:00100000:2.0:1788568615.420628:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976231424 00000100:00100000:2.0:1788568615.420641:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788568615.420647:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875449976231296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568615.420684:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875449976231296:12345-0@lo:400:kworker.0 Request processed in 37us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568615.420690:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788568615.420703:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788568615.421561:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788568615.421577:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae14350f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976231424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568615.421627:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae14350f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976231424:12345-0@lo:400:kworker.0 Request processed in 57us (1582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568615.421645:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1788568615.421705:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788568615.421710:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788568615.421712:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788568615.421755:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae27fec4e00 x1875449976231552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568615.421768:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976231552:0@lo:400:kworker.0 00000100:00100000:1.0:1788568615.421782:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976231424:0@lo:400:kworker.0 00000100:00100000:1.0:1788568615.421830:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875449976231296:0@lo:400:kworker.0 00010000:00080000:1.0:1788568615.421843:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae27fec5f80 x1875449976231808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568615.421852:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976231808:0@lo:400:kworker.0 00000100:00100000:1.0:1788568615.421883:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788568615.421891:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+19:3307:x1875449976231168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568615.421945:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+19:3307:x1875449976231168:12345-0@lo:400:kworker.0 Request processed in 54us (2192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568615.421951:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788568615.421979:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925db6b8-84bc-418c-b37a-40345c1020be:3307:1875449976231168:0@lo:400:kworker.0 00000100:00100000:2.0:1788568615.422045:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae28170a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875449976231680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568615.422280:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae28170a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875449976231680:12345-0@lo:400:kworker.0 Request processed in 1561us (2364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568615.422288:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788568615.424455:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875449976231680:0@lo:400:kworker.0 00000001:00100000:1.0:1788568615.495365:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 27f83c0c-e36b-48ce-9485-80051fd252dc 00000020:00000080:1.0:1788568615.495383:0:6717:0:(genops.c:885:class_export_put()) final put ffff9ae27ff23800/27f83c0c-e36b-48ce-9485-80051fd252dc 00000020:00000080:2.0:1788568615.495444:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae27ff23800/27f83c0c-e36b-48ce-9485-80051fd252dc for lustre-OST0000 00000020:00000080:2.0:1788568615.495482:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae27ff26800 for lustre-OST0000 00000100:00100000:3.0:1788568615.930033:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b564380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976231936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788568615.930109:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568615.930227:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976231936 00000100:00100000:2.0:1788568615.930235:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976231936 00000100:00100000:2.0:1788568615.930290:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788568615.930299:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976231936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788568615.930333:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788568615.930392:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976231936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568615.930399:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1788568615.930475:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae27b564380 x1875449976231936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568631 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568615.930495:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b564380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976231936:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788568616.125194:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568616.450322:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26f93e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976232064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788568616.450387:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568616.451398:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976232064 00000100:00100000:1.0:1788568616.451408:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976232064 00000100:00100000:1.0:1788568616.451459:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788568616.451467:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976232064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788568616.451502:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788568616.451557:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976232064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568616.451564:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1788568616.451607:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae26f93e300 x1875449976232064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568632 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568616.451625:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26f93e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976232064:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788568617.143307:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568618.167195:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788568618.540161:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 27f83c0c-e36b-48ce-9485-80051fd252dc 00000020:00000080:3.0:1788568618.540170:0:7647:0:(genops.c:885:class_export_put()) final put ffff9ae27bedf800/27f83c0c-e36b-48ce-9485-80051fd252dc 00000020:00000080:2.0:1788568618.540329:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae27bedf800/27f83c0c-e36b-48ce-9485-80051fd252dc for lustre-OST0001 00000020:00000080:2.0:1788568618.540753:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae27bed8000 for lustre-OST0001 00010000:00010000:2.0:1788568619.191213:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568619.545000:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568619.545046:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568619.545064:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958375168 00000100:00100000:1.0:1788568619.545074:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958375168 00000100:00100000:1.0:1788568619.545122:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 196 00000100:00100000:1.0:1788568619.545131:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+10:2363:x1875449958375168:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:0.0:1788568619.545270:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958375296 00000100:00100000:0.0:1788568619.545274:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958375296 00000100:00100000:0.0:1788568619.545325:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 43 00000100:00100000:0.0:1788568619.545333:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2363:x1875449958375296:12345-192.168.206.4@tcp:400:kworker.0 00000100:00080000:3.0:1788568619.545475:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788568619.547112:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+10:2363:x1875449958375168:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 1907us (2047us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568619.547126:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 196 00000100:00100000:0.0:1788568619.547331:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2363:x1875449958375296:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 1997us (2282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568619.547340:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 43 00000001:02000400:3.0:1788568619.609128:0:9250:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.2 00010000:00010000:1.0:1788568620.236834:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568620.536911:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976232192:0@lo:400:kworker.0 00000100:00100000:3.0:1788568620.536995:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568620.537040:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae1419bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875449976232704:0@lo:400:kworker.0 00000100:00100000:3.0:1788568620.537071:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568620.537110:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788568620.537116:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976232320:0@lo:400:kworker.0 00000100:00100000:3.0:1788568620.537138:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568620.537242:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae1419bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976232832:0@lo:400:kworker.0 00000100:00100000:3.0:1788568620.537269:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568620.537299:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae1419bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976232448:0@lo:400:kworker.0 00000100:00100000:3.0:1788568620.537336:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568620.537358:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788568620.537363:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae1419bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976232576:0@lo:400:kworker.0 00000100:00100000:3.0:1788568620.537395:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568620.539089:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976232704 00000100:00100000:3.0:1788568620.539374:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976232832 00000100:00100000:3.0:1788568620.539385:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976232832 00000100:00100000:3.0:1788568620.539443:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976232576 00000100:00100000:3.0:1788568620.539447:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976232576 00000100:00100000:3.0:1788568620.539471:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788568620.539484:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae1419bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976232832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568620.539558:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae1419bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976232832:12345-0@lo:400:kworker.0 Request processed in 79us (2287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568620.539566:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788568620.539584:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788568620.539591:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976232576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568620.539624:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976232576:12345-0@lo:400:kworker.0 Request processed in 34us (2228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568620.539631:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788568620.539649:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976232320 00000100:00100000:3.0:1788568620.539653:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976232320 00000100:00100000:3.0:1788568620.539677:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976232448 00000100:00100000:3.0:1788568620.539680:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976232448 00000100:00100000:3.0:1788568620.539695:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788568620.539717:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae1419bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976232320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568620.539748:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae1419bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976232320:12345-0@lo:400:kworker.0 Request processed in 47us (2608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568620.539754:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788568620.539777:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788568620.539784:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bed3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976232448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568620.539812:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bed3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976232448:12345-0@lo:400:kworker.0 Request processed in 29us (2476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568620.539830:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1788568620.539853:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788568620.539858:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788568620.539860:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788568620.539898:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae1419bd500 x1875449976232576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568620.539913:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae1419bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976232576:0@lo:400:kworker.0 00000100:00100000:3.0:1788568620.539943:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae1419bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976232448:0@lo:400:kworker.0 00000100:00100000:3.0:1788568620.539979:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976232320:0@lo:400:kworker.0 00010000:00080000:3.0:1788568620.539991:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae1419bd180 x1875449976232832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568620.540001:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae1419bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976232832:0@lo:400:kworker.0 00000100:00100000:1.0:1788568620.540424:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976232704 00000100:00100000:1.0:1788568620.540469:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788568620.540476:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae1419bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875449976232704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568620.540521:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae1419bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875449976232704:12345-0@lo:400:kworker.0 Request processed in 46us (3449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568620.540527:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788568620.540549:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976232192 00000100:00100000:1.0:1788568620.540553:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976232192 00000100:00100000:1.0:1788568620.540581:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788568620.540588:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+19:3306:x1875449976232192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568620.540619:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+19:3306:x1875449976232192:12345-0@lo:400:kworker.0 Request processed in 33us (3625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568620.540625:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:2.0:1788568620.541403:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788568620.542456:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976232192:0@lo:400:kworker.0 00000100:00100000:3.0:1788568620.542476:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae1419bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875449976232704:0@lo:400:kworker.0 00000100:00100000:3.0:1788568621.048423:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b565f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976232960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788568621.048512:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568621.048641:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976232960 00000100:00100000:2.0:1788568621.048652:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976232960 00000100:00100000:2.0:1788568621.048728:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788568621.048740:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976232960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788568621.048798:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788568621.048857:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976232960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568621.048865:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1788568621.048951:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae27b565f80 x1875449976232960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568637 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568621.048972:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b565f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976232960:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788568621.239278:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568621.559856:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788568621.567011:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26f93e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976233088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788568621.567088:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568621.567384:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976233088 00000100:00100000:3.0:1788568621.567395:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976233088 00000100:00100000:3.0:1788568621.567455:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788568621.567466:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b565f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976233088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788568621.567505:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788568621.567564:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b565f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976233088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568621.567588:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1788568621.567682:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae26f93e300 x1875449976233088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568637 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568621.567701:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26f93e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976233088:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788568622.264303:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788568622.587283:0:9347:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.2 00010000:00010000:2.0:1788568623.289566:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568624.311499:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568624.657330:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568624.657392:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568624.657564:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958375424 00000100:00100000:3.0:1788568624.657578:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958375424 00000100:00100000:3.0:1788568624.657657:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 198 00000100:00100000:3.0:1788568624.657672:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+10:2363:x1875449958375424:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:3.0:1788568624.657786:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+10:2363:x1875449958375424:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 118us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568624.657795:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 198 00000100:00100000:3.0:1788568624.657837:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958375552 00000100:00100000:3.0:1788568624.657841:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958375552 00000100:00100000:3.0:1788568624.657889:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 47 00000100:00100000:3.0:1788568624.657897:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2364:x1875449958375552:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:3.0:1788568624.658055:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2364:x1875449958375552:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 158us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568624.658062:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 47 00000100:00080000:2.0:1788568624.658149:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788568625.344625:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788568625.552840:0:9444:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.2 00000100:00100000:1.0:1788568625.661131:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26f93d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976233216:0@lo:400:kworker.0 00000100:00100000:1.0:1788568625.661248:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568625.661547:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26f93dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875449976233728:0@lo:400:kworker.0 00000100:00100000:1.0:1788568625.661583:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568625.661619:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788568625.661627:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26f93c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976233344:0@lo:400:kworker.0 00000100:00100000:1.0:1788568625.661654:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568625.661674:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26f93e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976233856:0@lo:400:kworker.0 00000100:00100000:1.0:1788568625.661703:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568625.661762:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976233216 00000100:00100000:1.0:1788568625.661773:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976233216 00000100:00100000:1.0:1788568625.662114:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788568625.662128:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+19:3306:x1875449976233216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568625.664661:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+19:3306:x1875449976233216:12345-0@lo:400:kworker.0 Request processed in 2524us (3401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568625.664678:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788568625.664769:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976233728 00000100:00100000:1.0:1788568625.664791:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976233728 00000100:00100000:2.0:1788568625.664812:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26f93d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976233216:0@lo:400:kworker.0 00000100:00100000:1.0:1788568625.664864:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976233344 00000100:00100000:1.0:1788568625.664869:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976233344 00000100:00100000:2.0:1788568625.664873:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788568625.664887:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875449976233728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568625.664897:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788568625.664907:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976233344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568625.665154:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976233344:12345-0@lo:400:kworker.0 Request processed in 248us (3499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568625.665162:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788568625.665193:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976233856 00000100:00100000:1.0:1788568625.665198:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976233856 00000100:00100000:1.0:1788568625.665242:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788568625.665250:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976233856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568625.665288:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976233856:12345-0@lo:400:kworker.0 Request processed in 39us (3584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568625.665295:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1788568625.665317:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788568625.665323:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788568625.666413:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26f93fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976233472:0@lo:400:kworker.0 00000100:00100000:0.0:1788568625.666494:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568625.666539:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788568625.666547:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26f93d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976233600:0@lo:400:kworker.0 00000100:00100000:0.0:1788568625.666576:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568625.666776:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976233600 00000100:00100000:0.0:1788568625.666788:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976233600 00000100:00100000:0.0:1788568625.666846:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788568625.666855:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae14350d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976233600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568625.666904:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae14350d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976233600:12345-0@lo:400:kworker.0 Request processed in 51us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568625.666912:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788568625.666981:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae26f93d880 x1875449976233600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568625.666998:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26f93d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976233600:0@lo:400:kworker.0 00000100:00080000:0.0:1788568625.667035:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788568625.667693:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875449976233728:12345-0@lo:400:kworker.0 Request processed in 2803us (6101us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568625.667706:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788568625.667747:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976233472 00000100:00100000:2.0:1788568625.667754:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976233472 00000100:00080000:0.0:1788568625.667898:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788568625.670288:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788568625.670320:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae14350d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976233472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568625.670540:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26f93fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976233472:0@lo:400:kworker.0 00000100:00100000:2.0:1788568625.670620:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae14350d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976233472:12345-0@lo:400:kworker.0 Request processed in 316us (4126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568625.670629:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788568625.673970:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26f93c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976233344:0@lo:400:kworker.0 00010000:00080000:0.0:1788568625.673999:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae26f93e300 x1875449976233856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568625.674012:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26f93e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976233856:0@lo:400:kworker.0 00000100:00100000:0.0:1788568625.674026:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26f93dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875449976233728:0@lo:400:kworker.0 00000100:00100000:2.0:1788568626.168066:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788568626.168107:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae14350c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976233984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788568626.168223:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568626.168291:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976233984 00000100:00100000:3.0:1788568626.168303:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976233984 00000100:00100000:3.0:1788568626.168366:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788568626.168379:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b567100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976233984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788568626.168428:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788568626.168496:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b567100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976233984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568626.168504:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1788568626.168588:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae14350c700 x1875449976233984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568642 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568626.168608:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae14350c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976233984:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788568626.361263:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568626.680470:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788568626.680498:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26f93ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976234112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788568626.680575:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568626.680717:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976234112 00000100:00100000:3.0:1788568626.680725:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976234112 00000100:00100000:3.0:1788568626.680817:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788568626.680828:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae14350fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976234112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788568626.680868:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788568626.680965:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae14350fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976234112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568626.680973:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1788568626.681052:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae26f93ed80 x1875449976234112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568642 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568626.681074:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26f93ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976234112:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788568627.214138:0:9493:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 4 20:37:04 EDT 2026 00010000:00010000:3.0:1788568627.388010:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568628.407274:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568629.432211:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568629.783739:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568629.783791:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568629.783885:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958375808 00000100:00100000:1.0:1788568629.783895:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958375808 00000100:00100000:3.0:1788568629.783963:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958375680 00000100:00100000:3.0:1788568629.783967:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958375680 00000100:00100000:1.0:1788568629.783978:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 51 00000100:00100000:1.0:1788568629.783988:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae14350d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2361:x1875449958375808:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:3.0:1788568629.783993:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 200 00000100:00100000:3.0:1788568629.783999:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+10:2361:x1875449958375680:12345-192.168.206.4@tcp:400:kworker.0 00000100:00080000:0.0:1788568629.784073:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788568629.784140:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae14350d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2361:x1875449958375808:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 153us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568629.784157:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 51 00000100:00100000:3.0:1788568629.785253:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+10:2361:x1875449958375680:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 1247us (1516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568629.785265:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 200 00010000:00010000:3.0:1788568630.455170:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568630.775610:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bed0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875449976234368:0@lo:400:kworker.0 00000100:00100000:2.0:1788568630.775703:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568630.775776:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788568630.775783:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925db6b8-84bc-418c-b37a-40345c1020be:3307:1875449976234240:0@lo:400:kworker.0 00000100:00100000:2.0:1788568630.775815:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568630.775857:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976234240 00000100:00100000:2.0:1788568630.775864:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976234240 00000100:00100000:2.0:1788568630.775912:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788568630.775921:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+19:3307:x1875449976234240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568630.775998:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+19:3307:x1875449976234240:12345-0@lo:400:kworker.0 Request processed in 78us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568630.776005:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788568630.776050:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925db6b8-84bc-418c-b37a-40345c1020be:3307:1875449976234240:0@lo:400:kworker.0 00000100:00100000:0.0:1788568630.776429:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bed1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976234496:0@lo:400:kworker.0 00000100:00100000:0.0:1788568630.776466:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568630.776483:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788568630.776488:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bed3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976234624:0@lo:400:kworker.0 00000100:00100000:0.0:1788568630.776507:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568630.776537:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bed2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875449976234752:0@lo:400:kworker.0 00000100:00100000:0.0:1788568630.776555:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568630.776760:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788568630.776768:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976234880:0@lo:400:kworker.0 00000100:00100000:0.0:1788568630.776811:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568630.776890:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976234624 00000100:00100000:3.0:1788568630.776895:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976234624 00000100:00100000:3.0:1788568630.776963:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976234880 00000100:00100000:3.0:1788568630.776966:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976234880 00000100:00100000:3.0:1788568630.776989:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788568630.777000:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae14350ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976234624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568630.777049:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae14350ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976234624:12345-0@lo:400:kworker.0 Request processed in 53us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568630.777055:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788568630.777069:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788568630.777076:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae14350f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976234880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568630.777106:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae14350f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976234880:12345-0@lo:400:kworker.0 Request processed in 32us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568630.777283:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976234368 00000100:00100000:2.0:1788568630.777288:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976234368 00000100:00100000:2.0:1788568630.777312:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976234496 00000100:00100000:2.0:1788568630.777314:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976234496 00000100:00100000:2.0:1788568630.777325:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976234752 00000100:00100000:2.0:1788568630.777327:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976234752 00000100:00100000:2.0:1788568630.777340:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788568630.777346:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875449976234368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568630.777532:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875449976234368:12345-0@lo:400:kworker.0 Request processed in 186us (1829us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568630.777547:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788568630.777560:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788568630.777567:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae14350dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976234496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568630.777598:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae14350dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976234496:12345-0@lo:400:kworker.0 Request processed in 32us (1131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568630.777604:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788568630.777615:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788568630.777620:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae14350ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875449976234752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568630.777647:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae14350ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875449976234752:12345-0@lo:400:kworker.0 Request processed in 27us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568630.777652:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1788568630.778849:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788568630.778859:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788568630.778862:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788568630.779027:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae27bed3100 x1875449976234624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568630.779044:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bed3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976234624:0@lo:400:kworker.0 00000100:00100000:0.0:1788568630.779057:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bed1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976234496:0@lo:400:kworker.0 00000100:00100000:0.0:1788568630.779104:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bed0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875449976234368:0@lo:400:kworker.0 00000100:00100000:3.0:1788568630.779622:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1788568630.779725:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae27bed3480 x1875449976234880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568630.779739:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976234880:0@lo:400:kworker.0 00000100:00100000:2.0:1788568630.779756:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bed2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875449976234752:0@lo:400:kworker.0 00000100:00100000:2.0:1788568631.290922:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae14350c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976235008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788568631.291032:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568631.291312:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976235008 00000100:00100000:3.0:1788568631.291320:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976235008 00000100:00100000:3.0:1788568631.291373:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788568631.291383:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b567480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976235008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788568631.291416:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788568631.291466:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b567480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976235008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568631.291472:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1788568631.291552:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae14350c000 x1875449976235008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568647 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568631.291570:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae14350c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976235008:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788568631.479987:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568631.802940:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b566300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976235136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788568631.803029:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568631.803061:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976235136 00000100:00100000:1.0:1788568631.803071:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976235136 00000100:00100000:1.0:1788568631.803129:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788568631.803141:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bed2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976235136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788568631.803182:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788568631.803348:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bed2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976235136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 208us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568631.803356:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1788568631.806826:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae27b566300 x1875449976235136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568647 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568631.806866:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b566300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976235136:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788568632.508710:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568633.527846:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568634.557056:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568634.902317:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568634.902360:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568634.902441:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958376064 00000100:00100000:1.0:1788568634.902677:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958376064 00000100:00100000:1.0:1788568634.902804:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 55 00000100:00100000:1.0:1788568634.902817:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae14350ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2363:x1875449958376064:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:1.0:1788568634.902916:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae14350ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2363:x1875449958376064:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 101us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568634.902944:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 55 00000100:00100000:3.0:1788568634.904805:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958375936 00000100:00100000:3.0:1788568634.904825:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958375936 00000100:00100000:3.0:1788568634.904918:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 202 00000100:00100000:3.0:1788568634.904946:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+10:2363:x1875449958375936:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:3.0:1788568634.905035:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+10:2363:x1875449958375936:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 107us (2733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568634.905043:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 202 00000100:00080000:0.0:1788568634.914811:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788568635.580527:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568635.896748:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae14350ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976235264:0@lo:400:kworker.0 00000100:00100000:0.0:1788568635.896860:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568635.896948:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae14350e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875449976235776:0@lo:400:kworker.0 00000100:00100000:0.0:1788568635.896981:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568635.897022:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788568635.897028:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae14350c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976235392:0@lo:400:kworker.0 00000100:00100000:0.0:1788568635.897071:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568635.897090:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae14350c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976235904:0@lo:400:kworker.0 00000100:00100000:0.0:1788568635.897117:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568635.897148:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae14350df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976235520:0@lo:400:kworker.0 00000100:00100000:0.0:1788568635.897172:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568635.897190:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788568635.897195:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae14350f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976235648:0@lo:400:kworker.0 00000100:00100000:0.0:1788568635.897224:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568635.897263:0:8111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976235904 00000100:00100000:0.0:1788568635.897272:0:8111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976235904 00000100:00100000:0.0:1788568635.897338:0:8111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976235648 00000100:00100000:0.0:1788568635.897341:0:8111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976235648 00000100:00100000:0.0:1788568635.897364:0:8111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788568635.897374:0:8111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976235904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568635.897436:0:8111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976235904:12345-0@lo:400:kworker.0 Request processed in 62us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568635.897443:0:8111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788568635.897463:0:8111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788568635.897470:0:8111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277ac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976235648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568635.897504:0:8111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277ac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976235648:12345-0@lo:400:kworker.0 Request processed in 35us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568635.897510:0:8111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1788568635.897527:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788568635.897531:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788568635.897565:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae14350f100 x1875449976235648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568635.897581:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae14350f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976235648:0@lo:400:kworker.0 00010000:00080000:0.0:1788568635.897614:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae14350c000 x1875449976235904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568635.897623:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae14350c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976235904:0@lo:400:kworker.0 00000100:00100000:3.0:1788568635.900134:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976235264 00000100:00100000:3.0:1788568635.900212:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976235264 00000100:00100000:3.0:1788568635.900282:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788568635.900308:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+19:3306:x1875449976235264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568635.900429:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+19:3306:x1875449976235264:12345-0@lo:400:kworker.0 Request processed in 125us (3569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568635.900436:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788568635.900576:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae14350ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976235264:0@lo:400:kworker.0 00000100:00100000:2.0:1788568635.901548:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976235776 00000100:00100000:2.0:1788568635.901560:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976235776 00000100:00100000:2.0:1788568635.901646:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976235392 00000100:00100000:2.0:1788568635.901650:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976235392 00000100:00100000:2.0:1788568635.901666:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976235520 00000100:00100000:2.0:1788568635.901669:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976235520 00000100:00100000:2.0:1788568635.901699:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788568635.901714:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae14350c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875449976235776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568635.901806:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae14350c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875449976235776:12345-0@lo:400:kworker.0 Request processed in 100us (4824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568635.901813:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788568635.901828:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788568635.901832:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277ac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976235392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568635.901858:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277ac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976235392:12345-0@lo:400:kworker.0 Request processed in 27us (4788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568635.901864:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788568635.901874:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788568635.901880:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976235520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568635.901914:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976235520:12345-0@lo:400:kworker.0 Request processed in 34us (4740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568635.901920:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788568635.902149:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae14350df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976235520:0@lo:400:kworker.0 00000100:00100000:2.0:1788568635.902200:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae14350c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976235392:0@lo:400:kworker.0 00000100:00100000:2.0:1788568635.902219:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae14350e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875449976235776:0@lo:400:kworker.0 00000100:00080000:3.0:1788568635.902862:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788568636.407271:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b565180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976236032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788568636.407373:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568636.409017:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976236032 00000100:00100000:1.0:1788568636.409034:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976236032 00000100:00100000:1.0:1788568636.409117:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788568636.409131:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bed1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976236032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788568636.409183:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788568636.409281:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bed1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976236032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 154us (1907us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568636.409289:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1788568636.409339:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae27b565180 x1875449976236032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568652 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568636.409379:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b565180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976236032:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788568636.606338:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568636.920045:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788568636.920076:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b565180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976236160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788568636.920554:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568636.920716:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976236160 00000100:00100000:2.0:1788568636.920727:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976236160 00000100:00100000:2.0:1788568636.920793:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788568636.920810:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b566300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976236160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788568636.921012:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788568636.921079:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b566300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976236160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 276us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568636.922515:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788568636.922602:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae27b565180 x1875449976236160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568652 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568636.922643:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b565180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976236160:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788568637.623535:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568638.648138:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568639.672422:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568640.019891:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568640.020022:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568640.020133:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958376320 00000100:00100000:2.0:1788568640.020151:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958376320 00000100:00100000:2.0:1788568640.020249:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 59 00000100:00100000:2.0:1788568640.020261:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277ac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2364:x1875449958376320:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:2.0:1788568640.020368:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277ac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2364:x1875449958376320:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 109us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568640.020375:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 59 00000100:00080000:0.0:1788568640.020750:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788568640.021694:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958376192 00000100:00100000:3.0:1788568640.021708:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958376192 00000100:00100000:3.0:1788568640.021791:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 204 00000100:00100000:3.0:1788568640.021802:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+10:2364:x1875449958376192:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:3.0:1788568640.021913:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+10:2364:x1875449958376192:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 113us (1890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568640.021960:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 204 00010000:00010000:1.0:1788568640.699817:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568641.015913:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b565180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976236288:0@lo:400:kworker.0 00000100:00100000:1.0:1788568641.016026:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568641.016069:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b564380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875449976236416:0@lo:400:kworker.0 00000100:00100000:1.0:1788568641.016095:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b565880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875449976236800:0@lo:400:kworker.0 00000100:00100000:2.0:1788568641.016107:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568641.016132:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976236288 00000100:00100000:1.0:1788568641.016141:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976236288 00000100:00100000:2.0:1788568641.016200:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277d94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976236928:0@lo:400:kworker.0 00000100:00100000:1.0:1788568641.016201:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788568641.016211:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+19:3306:x1875449976236288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568641.016230:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568641.016267:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+19:3306:x1875449976236288:12345-0@lo:400:kworker.0 Request processed in 57us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568641.016274:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b564e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976236544:0@lo:400:kworker.0 00000100:00100000:1.0:1788568641.016276:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788568641.016304:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568641.016324:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976236416 00000100:00100000:1.0:1788568641.016327:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976236416 00000100:00100000:2.0:1788568641.016331:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788568641.016336:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976236672:0@lo:400:kworker.0 00000100:00100000:1.0:1788568641.016355:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976236544 00000100:00100000:1.0:1788568641.016358:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976236544 00000100:00100000:2.0:1788568641.016367:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568641.016391:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788568641.016399:0:8111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976236928 00000100:00100000:1.0:1788568641.016399:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277d96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875449976236416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568641.016402:0:8111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976236928 00000100:00100000:2.0:1788568641.016434:0:8111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976236672 00000100:00100000:1.0:1788568641.016435:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277d96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875449976236416:12345-0@lo:400:kworker.0 Request processed in 37us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568641.016437:0:8111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976236672 00000100:00100000:1.0:1788568641.016441:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788568641.016453:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788568641.016458:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277d94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976236544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568641.016475:0:8111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788568641.016482:0:8111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976236928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568641.016487:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277d94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976236544:12345-0@lo:400:kworker.0 Request processed in 29us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568641.016500:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788568641.016517:0:8111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976236928:12345-0@lo:400:kworker.0 Request processed in 36us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568641.016522:0:8111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1788568641.016524:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788568641.016528:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788568641.016531:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788568641.016533:0:8111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788568641.016540:0:8111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976236672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568641.016572:0:8111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976236672:12345-0@lo:400:kworker.0 Request processed in 33us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568641.016578:0:8111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1788568641.016663:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae27b567b80 x1875449976236672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568641.016679:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976236672:0@lo:400:kworker.0 00000100:00100000:2.0:1788568641.016691:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b564e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976236544:0@lo:400:kworker.0 00000100:00100000:2.0:1788568641.016728:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b564380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875449976236416:0@lo:400:kworker.0 00010000:00080000:2.0:1788568641.016737:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae277d94000 x1875449976236928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568641.016752:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277d94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976236928:0@lo:400:kworker.0 00000100:00100000:2.0:1788568641.016782:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568641.016806:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b565180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976236288:0@lo:400:kworker.0 00000100:00100000:2.0:1788568641.016822:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976236800 00000100:00100000:2.0:1788568641.016825:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976236800 00000100:00100000:2.0:1788568641.016851:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788568641.016856:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277d94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875449976236800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568641.016890:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277d94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875449976236800:12345-0@lo:400:kworker.0 Request processed in 34us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568641.016897:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1788568641.016951:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788568641.017402:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b565880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875449976236800:0@lo:400:kworker.0 00000100:00100000:1.0:1788568641.532668:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788568641.532698:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277d97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976237056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788568641.533199:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568641.533288:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976237056 00000100:00100000:1.0:1788568641.533298:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976237056 00000100:00100000:1.0:1788568641.533354:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788568641.533364:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976237056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788568641.533528:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788568641.533623:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976237056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 259us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568641.533631:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1788568641.544406:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae277d97100 x1875449976237056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568657 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568641.544441:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277d97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976237056:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788568641.720084:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568642.039328:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788568642.039360:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277d97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976237184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788568642.039463:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568642.039735:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976237184 00000100:00100000:3.0:1788568642.039745:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976237184 00000100:00100000:3.0:1788568642.039823:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788568642.039836:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277ac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976237184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788568642.039883:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788568642.039974:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277ac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976237184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568642.039982:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1788568642.040161:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae277d97100 x1875449976237184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568658 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568642.040184:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277d97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976237184:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788568642.743535:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788568643.662757:0:10123:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 20:37:21 (1788568641) === 00010000:00010000:0.0:1788568643.771233:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568644.089818:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568644.090472:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958376448 00000100:00100000:1.0:1788568644.090485:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958376448 00000100:00100000:1.0:1788568644.090553:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 206 00000100:00100000:1.0:1788568644.090565:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+10:8135:x1875449958376448:12345-192.168.206.4@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788568644.090586:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568644.090611:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae282044600/0x41e82f464b6a0dda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bea15 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568644.090655:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae282044600/0x41e82f464b6a0dda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea15 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568644.090669:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae282044600/0x41e82f464b6a0dda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea15 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568644.090695:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae282044600, rc 0) 00000100:00100000:1.0:1788568644.090768:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+11:8135:x1875449958376448:12345-192.168.206.4@tcp:101:mount.lustre.0 Request processed in 205us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568644.090776:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 206 00000100:00100000:0.0:1788568644.097058:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568644.097211:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958376576 00000100:00100000:1.0:1788568644.097225:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958376576 00000100:00100000:1.0:1788568644.097297:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 207 00000100:00100000:1.0:1788568644.097308:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+11:8135:x1875449958376576:12345-192.168.206.4@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788568644.097721:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+11:8135:x1875449958376576:12345-192.168.206.4@tcp:501:mount.lustre.0 Request processed in 413us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568644.097730:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 207 00000100:00100000:2.0:1788568644.103412:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568644.103550:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958376704 00000100:00100000:3.0:1788568644.103564:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958376704 00000100:00100000:3.0:1788568644.103632:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 208 00000100:00100000:3.0:1788568644.103654:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+11:8135:x1875449958376704:12345-192.168.206.4@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788568644.103972:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+11:8135:x1875449958376704:12345-192.168.206.4@tcp:503:mount.lustre.0 Request processed in 321us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568644.103981:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 208 00000100:00100000:0.0:1788568644.111360:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568644.111634:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958376832 00000100:00100000:2.0:1788568644.111658:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958376832 00000100:00100000:2.0:1788568644.111728:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 209 00000100:00100000:2.0:1788568644.111741:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+11:8139:x1875449958376832:12345-192.168.206.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788568644.112157:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+11:8139:x1875449958376832:12345-192.168.206.4@tcp:502:llog_process_th.0 Request processed in 417us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568644.112178:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 209 00000100:00100000:0.0:1788568644.125790:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568644.126546:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958376960 00000100:00100000:1.0:1788568644.126560:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958376960 00000100:00100000:1.0:1788568644.126647:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 210 00000100:00100000:1.0:1788568644.126660:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+11:8139:x1875449958376960:12345-192.168.206.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788568644.127063:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+11:8139:x1875449958376960:12345-192.168.206.4@tcp:502:llog_process_th.0 Request processed in 404us (1286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568644.127073:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 210 00000100:00100000:1.0:1788568644.140140:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568644.140259:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958377088 00000100:00100000:2.0:1788568644.140274:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958377088 00000100:00100000:2.0:1788568644.140342:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 211 00000100:00100000:2.0:1788568644.140354:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+11:8135:x1875449958377088:12345-192.168.206.4@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788568644.140373:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568644.140395:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae252e7ac00/0x41e82f464b6a0de1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bea3f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568644.140430:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae252e7ac00/0x41e82f464b6a0de1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea3f expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568644.140455:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae252e7ac00/0x41e82f464b6a0de1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea3f expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568644.140465:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7ac00, rc 0) 00000100:00100000:2.0:1788568644.140528:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+12:8135:x1875449958377088:12345-192.168.206.4@tcp:101:mount.lustre.0 Request processed in 176us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568644.140535:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 211 00000100:00100000:0.0:1788568644.143199:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568644.143293:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958377216 00000100:00100000:3.0:1788568644.143304:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958377216 00000100:00100000:3.0:1788568644.143375:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 212 00000100:00100000:3.0:1788568644.143386:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+12:8135:x1875449958377216:12345-192.168.206.4@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788568644.143417:0:5835:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788568644.143458:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788568644.143463:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788568644.143466:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788568644.143469:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788568644.149226:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+12:8135:x1875449958377216:12345-192.168.206.4@tcp:256:mount.lustre.0 Request processed in 5825us (6022us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568644.149244:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 212 00000100:00100000:1.0:1788568644.155295:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568644.155404:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958377344 00000100:00100000:3.0:1788568644.155417:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958377344 00000100:00100000:3.0:1788568644.155679:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 213 00000100:00100000:3.0:1788568644.155694:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+12:8135:x1875449958377344:12345-192.168.206.4@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788568644.155717:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568644.155739:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0de8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bea46 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568644.155799:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0de8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea46 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568644.155812:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0de8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea46 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568644.155824:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429dee00, rc 0) 00000100:00100000:3.0:1788568644.155900:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+13:8135:x1875449958377344:12345-192.168.206.4@tcp:101:mount.lustre.0 Request processed in 211us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568644.155908:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 213 00000100:00100000:0.0:1788568644.159900:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568644.162891:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958377472 00000100:00100000:3.0:1788568644.162912:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958377472 00000100:00100000:2.0:1788568644.165724:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 214 00000100:00100000:2.0:1788568644.165743:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+13:8135:x1875449958377472:12345-192.168.206.4@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788568644.166316:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+13:8135:x1875449958377472:12345-192.168.206.4@tcp:501:mount.lustre.0 Request processed in 575us (6425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568644.166327:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 214 00000100:00100000:0.0:1788568644.171694:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568644.171867:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958377600 00000100:00100000:2.0:1788568644.171882:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958377600 00000100:00100000:2.0:1788568644.172044:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 215 00000100:00100000:2.0:1788568644.172071:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+13:8135:x1875449958377600:12345-192.168.206.4@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788568644.172485:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+13:8135:x1875449958377600:12345-192.168.206.4@tcp:503:mount.lustre.0 Request processed in 415us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568644.172508:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 215 00000100:00100000:1.0:1788568644.177417:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568644.177721:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958377728 00000100:00100000:2.0:1788568644.177733:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958377728 00000100:00100000:2.0:1788568644.177798:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 216 00000100:00100000:2.0:1788568644.177810:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+13:8144:x1875449958377728:12345-192.168.206.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788568644.178144:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+13:8144:x1875449958377728:12345-192.168.206.4@tcp:502:llog_process_th.0 Request processed in 334us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568644.178153:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 216 00000100:00100000:0.0:1788568644.184222:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568644.184314:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958377856 00000100:00100000:3.0:1788568644.184325:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958377856 00000100:00100000:3.0:1788568644.184394:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 217 00000100:00100000:3.0:1788568644.184406:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+13:8144:x1875449958377856:12345-192.168.206.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788568644.184734:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+13:8144:x1875449958377856:12345-192.168.206.4@tcp:502:llog_process_th.0 Request processed in 330us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568644.184743:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 217 00000100:00100000:0.0:1788568644.196858:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568644.197216:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958378240 00000100:00100000:2.0:1788568644.197229:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958378240 00000100:00100000:2.0:1788568644.197325:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 63 00000100:00100000:2.0:1788568644.197337:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277ac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2361:x1875449958378240:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:2.0:1788568644.197440:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277ac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2361:x1875449958378240:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 104us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568644.197448:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 63 00000100:00080000:1.0:1788568644.197835:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788568644.198195:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568644.200298:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958377984 00000100:00100000:2.0:1788568644.200316:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958377984 00000100:00100000:2.0:1788568644.200392:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 10 00000100:00100000:2.0:1788568644.200402:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2360:x1875449958377984:12345-192.168.206.4@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788568644.200451:0:5842:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from be1fd6d4-5648-47eb-88cd-3d695851ff89@192.168.206.4@tcp t0 exp 0000000000000000 cur 278 last 0 00000020:00000080:2.0:1788568644.200499:0:5842:0:(genops.c:1385:class_connect()) connect: client be1fd6d4-5648-47eb-88cd-3d695851ff89, cookie 0x41e82f464b6a0def 00000004:00100000:2.0:1788568644.200551:0:5842:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788568644.201697:0:5842:0:(import.c:65:import_set_state_nolock()) ffff9ae26f81a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788568644.201844:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be1fd6d4-5648-47eb-88cd-3d695851ff89+6:2360:x1875449958377984:12345-192.168.206.4@tcp:38:mount.lustre.0 Request processed in 1440us (3649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568644.201856:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 10 00000100:00100000:0.0:1788568644.206799:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568644.206859:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568644.206984:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958378112 00000100:00100000:3.0:1788568644.206998:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958378112 00000100:00100000:2.0:1788568644.207979:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958378368 00000100:00100000:2.0:1788568644.207989:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958378368 00000100:00100000:2.0:1788568644.208061:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 11 00000100:00100000:2.0:1788568644.208072:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277ac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be1fd6d4-5648-47eb-88cd-3d695851ff89+7:8135:x1875449958378368:12345-192.168.206.4@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788568644.208141:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788568644.208257:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277ac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be1fd6d4-5648-47eb-88cd-3d695851ff89+7:8135:x1875449958378368:12345-192.168.206.4@tcp:41:mount.lustre.0 Request processed in 186us (1396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568644.208265:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 11 00000100:00100000:0.0:1788568644.208736:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 12 00000100:00100000:0.0:1788568644.208747:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be1fd6d4-5648-47eb-88cd-3d695851ff89+6:0:x1875449958378112:12345-192.168.206.4@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788568644.208765:0:6714:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788568644.208802:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be1fd6d4-5648-47eb-88cd-3d695851ff89+6:0:x1875449958378112:12345-192.168.206.4@tcp:41:mount.lustre.0 Request processed in 58us (2018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568644.208809:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 12 00000100:00080000:1.0:1788568644.211755:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788568644.215287:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568644.218828:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958378496 00000100:00100000:2.0:1788568644.218848:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958378496 00000100:00100000:2.0:1788568644.219015:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 13 00000100:00100000:2.0:1788568644.219029:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277ac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be1fd6d4-5648-47eb-88cd-3d695851ff89+6:8135:x1875449958378496:12345-192.168.206.4@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788568644.219164:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277ac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be1fd6d4-5648-47eb-88cd-3d695851ff89+6:8135:x1875449958378496:12345-192.168.206.4@tcp:40:mount.lustre.0 Request processed in 138us (3892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568644.219172:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 13 00000100:00100000:1.0:1788568644.221442:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568644.221509:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568644.221550:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568644.221581:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958378880 00000100:00100000:3.0:1788568644.221855:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958378624 00000100:00100000:3.0:1788568644.221866:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958378624 00000100:00100000:3.0:1788568644.221909:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958378752 00000100:00100000:3.0:1788568644.221912:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958378752 00000100:00100000:3.0:1788568644.221961:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 12 00000100:00100000:3.0:1788568644.221970:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1875449958378624:12345-192.168.206.4@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788568644.222018:0:6690:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from be1fd6d4-5648-47eb-88cd-3d695851ff89@192.168.206.4@tcp t0 exp 0000000000000000 cur 278 last 0 00000020:00000080:3.0:1788568644.222056:0:6690:0:(genops.c:1385:class_connect()) connect: client be1fd6d4-5648-47eb-88cd-3d695851ff89, cookie 0x41e82f464b6a0df6 00002000:00100000:3.0:1788568644.222070:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli be1fd6d4-5648-47eb-88cd-3d695851ff89/ffff9ae277c24800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788568644.222098:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788568644.222712:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788568644.222756:0:6690:0:(import.c:65:import_set_state_nolock()) ffff9ae277c23000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788568644.222851:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:be1fd6d4-5648-47eb-88cd-3d695851ff89+6:2360:x1875449958378624:12345-192.168.206.4@tcp:8:mount.lustre.0 Request processed in 865us (1408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568644.222860:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 12 00000100:00100000:3.0:1788568644.222883:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 13 00000100:00100000:3.0:1788568644.222889:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1875449958378752:12345-192.168.206.4@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788568644.222906:0:6690:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from be1fd6d4-5648-47eb-88cd-3d695851ff89@192.168.206.4@tcp t0 exp 0000000000000000 cur 278 last 0 00000020:00000080:3.0:1788568644.222942:0:6690:0:(genops.c:1385:class_connect()) connect: client be1fd6d4-5648-47eb-88cd-3d695851ff89, cookie 0x41e82f464b6a0dfd 00002000:00100000:3.0:1788568644.222951:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli be1fd6d4-5648-47eb-88cd-3d695851ff89/ffff9ae277c26800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788568644.222968:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788568644.223768:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788568644.223796:0:6690:0:(import.c:65:import_set_state_nolock()) ffff9ae277c26000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788568644.223866:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:be1fd6d4-5648-47eb-88cd-3d695851ff89+6:2360:x1875449958378752:12345-192.168.206.4@tcp:8:mount.lustre.0 Request processed in 974us (2356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568644.223875:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 13 00000100:00100000:1.0:1788568644.223971:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958378880 00000100:00100000:1.0:1788568644.224027:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 1 00000100:00100000:1.0:1788568644.224035:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:be1fd6d4-5648-47eb-88cd-3d695851ff89+6:8135:x1875449958378880:12345-192.168.206.4@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788568644.224285:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788568644.224348:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:be1fd6d4-5648-47eb-88cd-3d695851ff89+6:8135:x1875449958378880:12345-192.168.206.4@tcp:33:mount.lustre.0 Request processed in 313us (2797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568644.224355:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 1 00010000:00010000:1.0:1788568644.791740:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568645.815951:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568646.143861:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26f93c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976237312:0@lo:400:kworker.0 00000100:00100000:1.0:1788568646.143979:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568646.144035:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875449976237824:0@lo:400:kworker.0 00000100:00100000:1.0:1788568646.144063:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568646.144093:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788568646.144099:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26f93fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976237440:0@lo:400:kworker.0 00000100:00100000:1.0:1788568646.144119:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568646.144136:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976237952:0@lo:400:kworker.0 00000100:00100000:1.0:1788568646.144162:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568646.144194:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26f93d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976237568:0@lo:400:kworker.0 00000100:00100000:1.0:1788568646.144217:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568646.144237:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788568646.144243:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26f93d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976237696:0@lo:400:kworker.0 00000100:00100000:1.0:1788568646.144292:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568646.144333:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976237312 00000100:00100000:1.0:1788568646.144350:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976237312 00000100:00100000:1.0:1788568646.144793:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788568646.144804:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+19:3306:x1875449976237312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568646.144868:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+19:3306:x1875449976237312:12345-0@lo:400:kworker.0 Request processed in 65us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568646.144876:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788568646.144915:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976237824 00000100:00100000:1.0:1788568646.144920:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976237824 00000100:00100000:1.0:1788568646.144982:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976237440 00000100:00100000:1.0:1788568646.144986:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976237440 00000100:00100000:1.0:1788568646.144999:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976237568 00000100:00100000:1.0:1788568646.145002:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976237568 00000100:00100000:1.0:1788568646.145018:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788568646.145024:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875449976237824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568646.145058:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875449976237824:12345-0@lo:400:kworker.0 Request processed in 34us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568646.145064:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788568646.145076:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788568646.145082:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976237440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568646.145106:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976237440:12345-0@lo:400:kworker.0 Request processed in 25us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568646.145112:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788568646.145122:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788568646.145128:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976237568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568646.145160:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976237568:12345-0@lo:400:kworker.0 Request processed in 32us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568646.145167:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788568646.145203:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976237952 00000100:00100000:1.0:1788568646.145207:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976237952 00000100:00100000:1.0:1788568646.145235:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976237696 00000100:00100000:1.0:1788568646.145238:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976237696 00000100:00100000:1.0:1788568646.145258:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788568646.145264:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976237952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568646.145296:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976237952:12345-0@lo:400:kworker.0 Request processed in 33us (1133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568646.145303:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788568646.145314:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788568646.145320:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fa21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976237696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568646.145348:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fa21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976237696:12345-0@lo:400:kworker.0 Request processed in 29us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568646.146396:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26f93fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976237440:0@lo:400:kworker.0 00010000:00080000:0.0:1788568646.146416:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae27fec7100 x1875449976237952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568646.146438:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976237952:0@lo:400:kworker.0 00000100:00100000:0.0:1788568646.146450:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26f93c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976237312:0@lo:400:kworker.0 00000100:00100000:0.0:1788568646.146462:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875449976237824:0@lo:400:kworker.0 00000100:00100000:1.0:1788568646.146633:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1788568646.147219:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788568646.147229:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788568646.147233:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788568646.148324:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae26f93d500 x1875449976237696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568646.148345:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26f93d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976237696:0@lo:400:kworker.0 00000100:00100000:1.0:1788568646.148421:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26f93d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976237568:0@lo:400:kworker.0 00000001:00100000:1.0:1788568646.303338:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of be1fd6d4-5648-47eb-88cd-3d695851ff89 00000100:00100000:1.0:1788568646.649938:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277d96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976238080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788568646.650033:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568646.651210:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976238080 00000100:00100000:0.0:1788568646.651223:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976238080 00000100:00100000:0.0:1788568646.651279:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788568646.651291:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fa21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976238080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788568646.651340:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788568646.651419:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fa21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976238080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (1385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568646.651427:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1788568646.651570:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae277d96680 x1875449976238080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568662 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568646.651613:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277d96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976238080:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788568646.839327:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568647.164425:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788568647.164456:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277d97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976238208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788568647.164543:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568647.164629:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976238208 00000100:00100000:2.0:1788568647.164639:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976238208 00000100:00100000:2.0:1788568647.164824:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788568647.164836:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277d96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976238208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788568647.164878:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788568647.164955:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277d96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976238208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568647.164964:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1788568647.165012:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae277d97480 x1875449976238208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568663 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568647.165033:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277d97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976238208:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788568647.871729:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568648.902919:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568649.233187:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568649.233233:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568649.233262:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568649.233279:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568649.233302:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568649.233334:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958379136 00000100:00100000:2.0:1788568649.233346:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958379136 00000100:00100000:2.0:1788568649.233405:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958379264 00000100:00100000:2.0:1788568649.233407:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958379264 00000100:00100000:2.0:1788568649.233434:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 67 00000100:00100000:2.0:1788568649.233444:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277d97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2361:x1875449958379136:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:2.0:1788568649.233542:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277d97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2361:x1875449958379136:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 89us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568649.233549:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 67 00000100:00100000:2.0:1788568649.233567:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 68 00000100:00100000:2.0:1788568649.233573:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277d95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be1fd6d4-5648-47eb-88cd-3d695851ff89+6:2361:x1875449958379264:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:2.0:1788568649.233605:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277d95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be1fd6d4-5648-47eb-88cd-3d695851ff89+6:2361:x1875449958379264:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 32us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568649.233636:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 68 00000100:00100000:2.0:1788568649.233654:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958379008 00000100:00100000:2.0:1788568649.233657:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958379008 00000100:00100000:2.0:1788568649.233682:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 219 00000100:00100000:2.0:1788568649.233689:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae250449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+13:2361:x1875449958379008:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:2.0:1788568649.233713:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae250449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+13:2361:x1875449958379008:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 25us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568649.233719:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 219 00000100:00100000:0.0:1788568649.235965:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958379392 00000100:00100000:0.0:1788568649.235986:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958379392 00000100:00100000:0.0:1788568649.236072:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958379520 00000100:00100000:0.0:1788568649.236077:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958379520 00000100:00100000:0.0:1788568649.236115:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 38 00000100:00100000:0.0:1788568649.236126:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277d95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2361:x1875449958379392:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:0.0:1788568649.236211:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277d95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2361:x1875449958379392:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 87us (2976us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568649.236220:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 38 00000100:00100000:0.0:1788568649.236241:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 39 00000100:00100000:0.0:1788568649.236249:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:be1fd6d4-5648-47eb-88cd-3d695851ff89+6:2361:x1875449958379520:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:0.0:1788568649.236303:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:be1fd6d4-5648-47eb-88cd-3d695851ff89+6:2361:x1875449958379520:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 54us (2998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568649.236383:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 39 00000100:00080000:0.0:1788568649.237270:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788568649.237278:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788568649.237281:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:3.0:1788568649.275258:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of be1fd6d4-5648-47eb-88cd-3d695851ff89 00000001:00100000:0.0:1788568649.277863:0:5865:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of be1fd6d4-5648-47eb-88cd-3d695851ff89 00010000:00010000:0.0:1788568649.911177:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788568650.687363:0:10318:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg604-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1788568650.936766:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568651.255644:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976238592:0@lo:400:kworker.0 00000100:00100000:1.0:1788568651.255680:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277d94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976238720:0@lo:400:kworker.0 00000100:00100000:2.0:1788568651.255711:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568651.255711:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568651.255769:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277d95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875449976238464:0@lo:400:kworker.0 00000100:00100000:0.0:1788568651.255778:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277d97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976238336:0@lo:400:kworker.0 00000100:00100000:2.0:1788568651.257956:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976238592 00000100:00100000:2.0:1788568651.257970:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976238592 00000100:00100000:2.0:1788568651.258034:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788568651.258044:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277d96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976238592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568651.258128:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277d96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976238592:12345-0@lo:400:kworker.0 Request processed in 87us (2417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568651.258135:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788568651.258178:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976238592:0@lo:400:kworker.0 00000100:00100000:2.0:1788568651.258222:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976238720 00000100:00100000:2.0:1788568651.258227:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976238720 00000100:00100000:2.0:1788568651.258255:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788568651.258261:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fa20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976238720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568651.258307:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fa20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976238720:12345-0@lo:400:kworker.0 Request processed in 46us (2596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568651.258313:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1788568651.258396:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788568651.258402:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788568651.261855:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae277d94e00 x1875449976238720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568651.261875:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277d94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976238720:0@lo:400:kworker.0 00000100:00100000:3.0:1788568651.265996:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568651.266044:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277d97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976238976:0@lo:400:kworker.0 00000100:00100000:3.0:1788568651.266082:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568651.266739:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976238464 00000100:00100000:1.0:1788568651.266747:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976238464 00000100:00100000:1.0:1788568651.266797:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788568651.266806:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bed1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875449976238464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568651.266869:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bed1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875449976238464:12345-0@lo:400:kworker.0 Request processed in 64us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568651.266877:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788568651.267060:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976238976 00000100:00100000:2.0:1788568651.267065:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976238976 00000100:00100000:2.0:1788568651.267117:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788568651.267124:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bed0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976238976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568651.267166:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bed0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976238976:12345-0@lo:400:kworker.0 Request processed in 43us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568651.267173:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788568651.268409:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277d95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875449976238464:0@lo:400:kworker.0 00010000:00080000:3.0:1788568651.268427:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae277d97800 x1875449976238976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568651.268437:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277d97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976238976:0@lo:400:kworker.0 00000100:00080000:1.0:1788568651.269518:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788568651.269689:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568651.269721:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976238336 00000100:00100000:0.0:1788568651.269727:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976238336 00000100:00100000:0.0:1788568651.269762:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788568651.269770:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae250449450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+19:3306:x1875449976238336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568651.269812:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae250449450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+19:3306:x1875449976238336:12345-0@lo:400:kworker.0 Request processed in 43us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568651.269818:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788568651.269867:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277d97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976238336:0@lo:400:kworker.0 00000100:00100000:0.0:1788568651.269877:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277d96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875449976238848:0@lo:400:kworker.0 00000100:00100000:0.0:1788568651.269916:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568651.269952:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976238848 00000100:00100000:0.0:1788568651.269955:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976238848 00000100:00100000:0.0:1788568651.269983:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788568651.269988:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277ac5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875449976238848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568651.270013:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277ac5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875449976238848:12345-0@lo:400:kworker.0 Request processed in 25us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568651.270033:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788568651.270059:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277d96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875449976238848:0@lo:400:kworker.0 00000100:00080000:0.0:1788568651.270081:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788568651.771395:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788568651.771418:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976239104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788568651.771501:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568651.771572:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976239104 00000100:00100000:2.0:1788568651.771580:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976239104 00000100:00100000:2.0:1788568651.771641:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788568651.771650:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976239104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788568651.771682:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788568651.771726:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976239104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568651.771733:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1788568651.771774:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae277d95c00 x1875449976239104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568667 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568651.771792:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976239104:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788568651.960479:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568652.284756:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788568652.284779:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bed3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976239232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788568652.284843:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568652.284906:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976239232 00000100:00100000:3.0:1788568652.284914:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976239232 00000100:00100000:3.0:1788568652.284974:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788568652.284983:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bed1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976239232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788568652.285018:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788568652.285060:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bed1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976239232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568652.285068:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1788568652.285109:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae27bed3b80 x1875449976239232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568668 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568652.285125:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bed3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976239232:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788568652.983095:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568654.007446:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568654.352861:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568654.352905:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568654.352963:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568654.353005:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568654.353029:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568654.353055:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958379648 00000100:00100000:3.0:1788568654.353065:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958379648 00000100:00100000:3.0:1788568654.353116:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 221 00000100:00100000:3.0:1788568654.353126:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+13:2363:x1875449958379648:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:3.0:1788568654.353191:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+13:2363:x1875449958379648:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 66us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568654.353198:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 221 00000100:00100000:3.0:1788568654.353230:0:8111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958380032 00000100:00100000:3.0:1788568654.353236:0:8111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958380032 00000100:00100000:3.0:1788568654.353269:0:8111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958380160 00000100:00100000:3.0:1788568654.353271:0:8111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958380160 00000100:00100000:3.0:1788568654.353292:0:8111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 42 00000100:00100000:3.0:1788568654.353299:0:8111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f561050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2363:x1875449958380032:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:3.0:1788568654.353339:0:8111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f561050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2363:x1875449958380032:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 40us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568654.353346:0:8111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 42 00000100:00100000:3.0:1788568654.353497:0:8111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 43 00000100:00100000:3.0:1788568654.353505:0:8111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bed0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2363:x1875449958380160:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:3.0:1788568654.353526:0:8111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bed0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2363:x1875449958380160:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 23us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568654.353532:0:8111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 43 00000100:00100000:1.0:1788568654.353781:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958379776 00000100:00100000:1.0:1788568654.353787:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958379776 00000100:00100000:1.0:1788568654.353825:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958379904 00000100:00100000:1.0:1788568654.353828:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958379904 00000100:00100000:1.0:1788568654.353850:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 72 00000100:00100000:1.0:1788568654.353857:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bed3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2363:x1875449958379776:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:1.0:1788568654.353893:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bed3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2363:x1875449958379776:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 36us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568654.353899:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 72 00000100:00100000:1.0:1788568654.353911:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 73 00000100:00100000:1.0:1788568654.353945:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2363:x1875449958379904:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:1.0:1788568654.353971:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2363:x1875449958379904:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 47us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568654.353977:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 73 00000100:00080000:2.0:1788568654.359320:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788568654.359332:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788568654.359334:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788568655.034099:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568656.058853:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568656.377788:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26fa20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976239616:0@lo:400:kworker.0 00000100:00100000:1.0:1788568656.377852:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568656.377900:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788568656.377906:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26fa22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976239744:0@lo:400:kworker.0 00000100:00100000:1.0:1788568656.377951:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568656.377986:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976239616 00000100:00100000:1.0:1788568656.377994:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976239616 00000100:00100000:1.0:1788568656.378046:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788568656.378054:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fa21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976239616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568656.378101:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fa21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976239616:12345-0@lo:400:kworker.0 Request processed in 47us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568656.378109:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788568656.378132:0:8111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976239744 00000100:00100000:1.0:1788568656.378135:0:8111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976239744 00000100:00100000:0.0:1788568656.378467:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26fa22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976239360:0@lo:400:kworker.0 00000100:00100000:0.0:1788568656.378511:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568656.378536:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26fa20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875449976239872:0@lo:400:kworker.0 00000100:00100000:0.0:1788568656.378557:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568656.378585:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788568656.378590:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26fa23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976239488:0@lo:400:kworker.0 00000100:00100000:0.0:1788568656.378612:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568656.378629:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26fa20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976240000:0@lo:400:kworker.0 00000100:00100000:0.0:1788568656.378647:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568656.378674:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976239360 00000100:00100000:0.0:1788568656.378677:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976239360 00000100:00100000:0.0:1788568656.378705:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788568656.378711:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+19:3306:x1875449976239360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568656.378742:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+19:3306:x1875449976239360:12345-0@lo:400:kworker.0 Request processed in 31us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568656.378748:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788568656.378772:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976239872 00000100:00100000:0.0:1788568656.378776:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976239872 00000100:00100000:0.0:1788568656.378796:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976239488 00000100:00100000:0.0:1788568656.378799:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976239488 00000100:00100000:0.0:1788568656.378826:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788568656.378831:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277ac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875449976239872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568656.378859:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277ac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875449976239872:12345-0@lo:400:kworker.0 Request processed in 28us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568656.378864:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788568656.378876:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788568656.378881:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976239488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568656.378903:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976239488:12345-0@lo:400:kworker.0 Request processed in 22us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568656.378908:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788568656.378948:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976240000 00000100:00100000:0.0:1788568656.378952:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976240000 00000100:00100000:0.0:1788568656.378980:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788568656.378987:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277ac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976240000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568656.379019:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277ac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976240000:12345-0@lo:400:kworker.0 Request processed in 32us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568656.379024:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788568656.379064:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26fa23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976239488:0@lo:400:kworker.0 00010000:00080000:0.0:1788568656.379076:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae26fa20380 x1875449976240000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568656.379085:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26fa20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976240000:0@lo:400:kworker.0 00000100:00100000:0.0:1788568656.379092:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26fa22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976239360:0@lo:400:kworker.0 00000100:00100000:0.0:1788568656.379099:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26fa20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875449976239872:0@lo:400:kworker.0 00000100:00080000:0.0:1788568656.379144:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788568656.379153:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788568656.379178:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26fa20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976239616:0@lo:400:kworker.0 00000100:00100000:1.0:1788568656.383548:0:8111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788568656.383561:0:8111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fa23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976239744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568656.383674:0:8111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fa23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976239744:12345-0@lo:400:kworker.0 Request processed in 116us (5722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568656.383682:0:8111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1788568656.384673:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae26fa22d80 x1875449976239744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568656.384690:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26fa22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976239744:0@lo:400:kworker.0 00000100:00080000:0.0:1788568656.388975:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788568656.887729:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788568656.887764:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976240128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788568656.887830:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568656.888163:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976240128 00000100:00100000:2.0:1788568656.888177:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976240128 00000100:00100000:2.0:1788568656.888228:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788568656.888237:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976240128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788568656.888270:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788568656.889727:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976240128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1482us (1888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568656.889739:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1788568656.897209:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae277d95c00 x1875449976240128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568672 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568656.897239:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976240128:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788568657.083694:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568657.399245:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bed0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976240256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788568657.399336:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568657.399667:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976240256 00000100:00100000:2.0:1788568657.399676:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976240256 00000100:00100000:2.0:1788568657.399727:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788568657.399736:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976240256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788568657.399771:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788568657.399823:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976240256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568657.399831:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1788568657.399876:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae27bed0700 x1875449976240256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568673 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568657.399896:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bed0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976240256:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788568658.107798:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568659.128097:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568659.475847:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568659.475886:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568659.475911:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568659.475950:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568659.475980:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568659.476014:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958380416 00000100:00100000:3.0:1788568659.476026:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958380416 00000100:00100000:3.0:1788568659.476094:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958380544 00000100:00100000:3.0:1788568659.476098:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958380544 00000100:00100000:3.0:1788568659.476129:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 77 00000100:00100000:3.0:1788568659.476141:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bed2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2362:x1875449958380416:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:3.0:1788568659.476228:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bed2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2362:x1875449958380416:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 89us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568659.476236:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 77 00000100:00100000:3.0:1788568659.476254:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 78 00000100:00100000:3.0:1788568659.476261:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2361:x1875449958380544:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:2.0:1788568659.476423:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958380288 00000100:00100000:2.0:1788568659.476428:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958380288 00000100:00100000:2.0:1788568659.476461:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 223 00000100:00100000:2.0:1788568659.476468:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+13:2361:x1875449958380288:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:2.0:1788568659.476499:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+13:2361:x1875449958380288:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 32us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568659.476506:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 223 00000100:00100000:3.0:1788568659.477973:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2361:x1875449958380544:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 1705us (2053us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568659.477985:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 78 00000100:00100000:3.0:1788568659.478023:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958380672 00000100:00100000:3.0:1788568659.478031:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958380672 00000100:00100000:3.0:1788568659.478082:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958380800 00000100:00100000:3.0:1788568659.478086:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958380800 00000100:00100000:3.0:1788568659.478116:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 46 00000100:00100000:3.0:1788568659.478124:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bed2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2362:x1875449958380672:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:3.0:1788568659.478166:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bed2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2362:x1875449958380672:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 43us (2215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568659.478173:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 46 00000100:00100000:3.0:1788568659.478185:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 47 00000100:00100000:3.0:1788568659.478193:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bed3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2361:x1875449958380800:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:3.0:1788568659.478213:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bed3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2361:x1875449958380800:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 23us (2234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568659.478219:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 47 00000100:00080000:3.0:1788568659.478241:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788568659.478245:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788568659.478248:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788568660.153395:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568661.180379:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568661.495701:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277ac4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976240384:0@lo:400:kworker.0 00000100:00100000:0.0:1788568661.495809:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568661.495886:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277ac4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875449976240896:0@lo:400:kworker.0 00000100:00100000:0.0:1788568661.495922:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568661.495986:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788568661.495995:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277ac6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976240512:0@lo:400:kworker.0 00000100:00100000:0.0:1788568661.496024:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568661.496066:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976241024:0@lo:400:kworker.0 00000100:00100000:0.0:1788568661.496100:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568661.496135:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277ac6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976240768:0@lo:400:kworker.0 00000100:00100000:0.0:1788568661.496160:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568661.496193:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788568661.496198:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875449976240640:0@lo:400:kworker.0 00000100:00100000:0.0:1788568661.496219:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568661.496251:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976240384 00000100:00100000:0.0:1788568661.496261:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976240384 00000100:00100000:0.0:1788568661.496337:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788568661.496348:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae250448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+19:3306:x1875449976240384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568661.496419:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae250448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+19:3306:x1875449976240384:12345-0@lo:400:kworker.0 Request processed in 71us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568661.496427:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788568661.496472:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976240896 00000100:00100000:0.0:1788568661.496476:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976240896 00000100:00100000:0.0:1788568661.496523:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976240512 00000100:00100000:0.0:1788568661.496526:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976240512 00000100:00100000:0.0:1788568661.496540:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976240640 00000100:00100000:0.0:1788568661.496555:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976240640 00000100:00100000:0.0:1788568661.496576:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788568661.496583:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fec6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875449976240896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568661.496624:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fec6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875449976240896:12345-0@lo:400:kworker.0 Request processed in 42us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568661.496631:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788568661.496643:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788568661.496650:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976240512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568661.496677:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976240512:12345-0@lo:400:kworker.0 Request processed in 29us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568661.496683:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788568661.496695:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788568661.496700:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875449976240640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568661.496743:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875449976240640:12345-0@lo:400:kworker.0 Request processed in 43us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568661.496752:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788568661.496780:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976241024 00000100:00100000:0.0:1788568661.496784:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976241024 00000100:00100000:0.0:1788568661.496820:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976240768 00000100:00100000:0.0:1788568661.496823:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976240768 00000100:00100000:0.0:1788568661.496847:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788568661.496856:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fec7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976241024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568661.496895:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fec7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976241024:12345-0@lo:400:kworker.0 Request processed in 42us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568661.496919:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788568661.496955:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788568661.496962:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976240768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568661.496994:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976240768:12345-0@lo:400:kworker.0 Request processed in 34us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568661.497000:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788568661.497454:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875449976240640:0@lo:400:kworker.0 00010000:00080000:0.0:1788568661.497472:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae277ac6d80 x1875449976240768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568661.497482:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277ac6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976240768:0@lo:400:kworker.0 00000100:00100000:0.0:1788568661.497675:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277ac6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976240512:0@lo:400:kworker.0 00010000:00080000:0.0:1788568661.497689:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae27fec4a80 x1875449976241024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568661.497697:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976241024:0@lo:400:kworker.0 00000100:00100000:0.0:1788568661.497720:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277ac4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976240384:0@lo:400:kworker.0 00000100:00100000:0.0:1788568661.497733:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277ac4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875449976240896:0@lo:400:kworker.0 00000100:00080000:3.0:1788568661.499199:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788568661.499211:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788568661.499215:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788568662.009265:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26f93df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976241152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788568662.011044:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568662.011155:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976241152 00000100:00100000:0.0:1788568662.011165:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976241152 00000100:00100000:0.0:1788568662.011222:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788568662.011234:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976241152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788568662.012426:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788568662.012517:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976241152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1282us (1473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568662.012526:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1788568662.013695:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae26f93df80 x1875449976241152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568678 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568662.013722:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26f93df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976241152:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788568662.204654:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568662.525642:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bed0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976241280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788568662.525721:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568662.526393:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976241280 00000100:00100000:0.0:1788568662.526402:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976241280 00000100:00100000:0.0:1788568662.526495:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788568662.526506:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976241280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788568662.526551:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788568662.526614:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976241280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568662.526632:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1788568662.526697:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae27bed0380 x1875449976241280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568678 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568662.526715:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bed0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976241280:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788568663.223147:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568664.256222:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568664.602131:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568664.602186:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568664.602224:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568664.602284:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568664.602328:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568664.602360:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958381184 00000100:00100000:1.0:1788568664.602369:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958381184 00000100:00100000:1.0:1788568664.602426:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958381056 00000100:00100000:1.0:1788568664.602429:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958381056 00000100:00100000:1.0:1788568664.602457:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 82 00000100:00100000:1.0:1788568664.602467:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fa22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2362:x1875449958381184:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:1.0:1788568664.602564:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fa22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2362:x1875449958381184:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 98us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568664.602572:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 82 00000100:00100000:1.0:1788568664.602590:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 83 00000100:00100000:1.0:1788568664.602597:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fa21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2362:x1875449958381056:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:1.0:1788568664.602620:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fa21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2362:x1875449958381056:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 24us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568664.602625:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 83 00000100:00080000:1.0:1788568664.602642:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788568664.602891:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958381312 00000100:00100000:3.0:1788568664.602896:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958381312 00000100:00100000:3.0:1788568664.602961:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958381440 00000100:00100000:3.0:1788568664.602964:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958381440 00000100:00100000:3.0:1788568664.602989:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 14 00000100:00100000:3.0:1788568664.602997:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fa22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2360:x1875449958381312:12345-192.168.206.4@tcp:9:kworker.0 00000020:00000080:3.0:1788568664.603025:0:6691:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x41e82f464b6a0df6 00000100:00080000:3.0:1788568664.603034:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9ae277c23000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788568664.603071:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788568664.603374:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fa22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:be1fd6d4-5648-47eb-88cd-3d695851ff89+2:2360:x1875449958381312:12345-192.168.206.4@tcp:9:kworker.0 Request processed in 377us (1252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568664.603382:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 14 00000100:00100000:3.0:1788568664.603396:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 15 00000100:00100000:3.0:1788568664.603404:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fa23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2360:x1875449958381440:12345-192.168.206.4@tcp:9:kworker.0 00000020:00000080:3.0:1788568664.603417:0:6691:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x41e82f464b6a0dfd 00000100:00080000:3.0:1788568664.603422:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9ae277c26000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788568664.603446:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788568664.605023:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fa23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:be1fd6d4-5648-47eb-88cd-3d695851ff89+2:2360:x1875449958381440:12345-192.168.206.4@tcp:9:kworker.0 Request processed in 1613us (2791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568664.605033:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 15 00010000:00010000:3.0:1788568664.605072:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568664.605179:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788568664.606266:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788568664.606273:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788568664.608824:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958380928 00000100:00100000:2.0:1788568664.608837:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958380928 00000100:00100000:2.0:1788568664.608910:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 225 00000100:00100000:2.0:1788568664.608920:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae250448850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+13:2362:x1875449958380928:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:2.0:1788568664.609027:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae250448850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+13:2362:x1875449958380928:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 108us (6840us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568664.609035:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 225 00010000:00010000:3.0:1788568665.271109:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568666.299989:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568666.615256:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26fa20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875449976241536:0@lo:400:kworker.0 00000100:00100000:3.0:1788568666.615328:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568666.615384:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26fa20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976242048:0@lo:400:kworker.0 00000100:00100000:3.0:1788568666.615408:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568666.615438:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788568666.615444:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26fa21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925db6b8-84bc-418c-b37a-40345c1020be:3307:1875449976241408:0@lo:400:kworker.0 00000100:00100000:3.0:1788568666.615471:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568666.615490:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26fa20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875449976241920:0@lo:400:kworker.0 00000100:00100000:3.0:1788568666.615539:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568666.615578:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26fa23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976241664:0@lo:400:kworker.0 00000100:00100000:3.0:1788568666.615599:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568666.615618:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788568666.615622:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26fa22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976241792:0@lo:400:kworker.0 00000100:00100000:3.0:1788568666.615641:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568666.615670:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976242048 00000100:00100000:3.0:1788568666.615676:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976242048 00000100:00100000:3.0:1788568666.615721:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976241792 00000100:00100000:3.0:1788568666.615724:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976241792 00000100:00100000:3.0:1788568666.615744:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788568666.615755:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bed1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976242048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568666.615800:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bed1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976242048:12345-0@lo:400:kworker.0 Request processed in 49us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568666.615807:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788568666.615822:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788568666.615829:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281709500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976241792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568666.615867:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281709500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976241792:12345-0@lo:400:kworker.0 Request processed in 39us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568666.615873:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788568666.615889:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976241536 00000100:00100000:3.0:1788568666.615892:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976241536 00000100:00100000:3.0:1788568666.615913:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976241920 00000100:00100000:3.0:1788568666.615915:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976241920 00000100:00100000:3.0:1788568666.615954:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976241664 00000100:00100000:3.0:1788568666.615958:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976241664 00000100:00100000:0.0:1788568666.616239:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976241408 00000100:00100000:0.0:1788568666.616244:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976241408 00000100:00100000:0.0:1788568666.616280:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788568666.616287:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae250449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+19:3307:x1875449976241408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568666.616320:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae250449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+19:3307:x1875449976241408:12345-0@lo:400:kworker.0 Request processed in 34us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568666.616326:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788568666.617389:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788568666.617405:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875449976241536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568666.617471:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875449976241536:12345-0@lo:400:kworker.0 Request processed in 72us (2143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568666.623773:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788568666.623818:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bed3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875449976241920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568666.624078:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bed3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875449976241920:12345-0@lo:400:kworker.0 Request processed in 291us (8536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568666.624086:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788568666.624114:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788568666.624120:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bed0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976241664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568666.624163:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bed0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976241664:12345-0@lo:400:kworker.0 Request processed in 43us (8562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568666.624169:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788568666.624540:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1788568666.624674:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788568666.624680:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788568666.624683:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788568666.626694:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae26fa22d80 x1875449976241792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568666.626711:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26fa22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976241792:0@lo:400:kworker.0 00000100:00100000:3.0:1788568666.626725:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26fa23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976241664:0@lo:400:kworker.0 00000100:00100000:3.0:1788568666.626765:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26fa21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925db6b8-84bc-418c-b37a-40345c1020be:3307:1875449976241408:0@lo:400:kworker.0 00000100:00100000:3.0:1788568666.626777:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26fa20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875449976241920:0@lo:400:kworker.0 00000100:00100000:3.0:1788568666.626787:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26fa20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875449976241536:0@lo:400:kworker.0 00010000:00080000:3.0:1788568666.626798:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae26fa20a80 x1875449976242048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568666.626807:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26fa20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976242048:0@lo:400:kworker.0 00000001:00100000:0.0:1788568666.754719:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of be1fd6d4-5648-47eb-88cd-3d695851ff89 00000020:00000080:0.0:1788568666.754729:0:6717:0:(genops.c:885:class_export_put()) final put ffff9ae277c24800/be1fd6d4-5648-47eb-88cd-3d695851ff89 00000020:00000080:1.0:1788568666.754764:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae277c24800/be1fd6d4-5648-47eb-88cd-3d695851ff89 for lustre-OST0000 00000020:00000080:1.0:1788568666.754810:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae277c23000 for lustre-OST0000 00000100:00100000:3.0:1788568667.127233:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26f93ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976242176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788568667.127299:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568667.127813:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976242176 00000100:00100000:2.0:1788568667.127822:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976242176 00000100:00100000:2.0:1788568667.127874:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788568667.127884:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281709c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976242176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788568667.127920:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788568667.128002:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281709c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976242176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568667.128009:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1788568667.128141:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae26f93ea00 x1875449976242176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568683 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568667.128161:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26f93ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976242176:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788568667.319140:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568667.645259:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788568667.645300:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae28170ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976242304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788568667.645413:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568667.645508:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976242304 00000100:00100000:3.0:1788568667.645531:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976242304 00000100:00100000:3.0:1788568667.645604:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788568667.645616:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae28170a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976242304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788568667.645660:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788568667.645715:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae28170a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976242304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568667.645722:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1788568667.645769:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae28170ad80 x1875449976242304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568683 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568667.645790:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae28170ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976242304:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788568668.346099:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568669.367155:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568669.715985:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568669.716162:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568669.716199:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958381696 00000100:00100000:1.0:1788568669.716211:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958381696 00000100:00100000:2.0:1788568669.717670:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958381568 00000100:00100000:2.0:1788568669.717687:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958381568 00000100:00100000:3.0:1788568669.717821:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568669.717853:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958381824 00000100:00100000:3.0:1788568669.717857:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958381824 00000100:00100000:1.0:1788568669.718008:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 87 00000100:00100000:1.0:1788568669.718021:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fa22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2361:x1875449958381696:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:1.0:1788568669.718117:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fa22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2361:x1875449958381696:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 98us (1954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568669.718125:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 87 00000100:00100000:3.0:1788568669.718212:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 88 00000100:00100000:3.0:1788568669.718237:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae28170ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2362:x1875449958381824:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:3.0:1788568669.718272:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae28170ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2362:x1875449958381824:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 44us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568669.718280:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 88 00000100:00100000:2.0:1788568669.718495:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 227 00000100:00100000:2.0:1788568669.718517:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+13:2361:x1875449958381568:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:2.0:1788568669.718548:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+13:2361:x1875449958381568:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 46us (2590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568669.718555:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 227 00000100:00080000:1.0:1788568669.733560:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:0.0:1788568669.769037:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of be1fd6d4-5648-47eb-88cd-3d695851ff89 00000020:00000080:0.0:1788568669.769049:0:7647:0:(genops.c:885:class_export_put()) final put ffff9ae277c26800/be1fd6d4-5648-47eb-88cd-3d695851ff89 00000020:00000080:1.0:1788568669.769486:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae277c26800/be1fd6d4-5648-47eb-88cd-3d695851ff89 for lustre-OST0001 00000020:00000080:1.0:1788568669.769571:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae277c26000 for lustre-OST0001 00000001:02000400:2.0:1788568670.299177:0:11022:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788568670.397299:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568671.417286:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568671.737429:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae281708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976242432:0@lo:400:kworker.0 00000100:00100000:3.0:1788568671.737544:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568671.737603:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae251dc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875449976242944:0@lo:400:kworker.0 00000100:00100000:3.0:1788568671.737633:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568671.737664:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788568671.737670:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae28170b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976242560:0@lo:400:kworker.0 00000100:00100000:3.0:1788568671.737693:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568671.737726:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae251dc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976243072:0@lo:400:kworker.0 00000100:00100000:3.0:1788568671.737751:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568671.737785:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae251dc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976242688:0@lo:400:kworker.0 00000100:00100000:3.0:1788568671.737807:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568671.737825:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788568671.737830:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae251dc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976242816:0@lo:400:kworker.0 00000100:00100000:3.0:1788568671.737849:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568671.737888:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976242432 00000100:00100000:3.0:1788568671.737899:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976242432 00000100:00100000:3.0:1788568671.737993:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788568671.738005:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+19:3306:x1875449976242432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568671.738063:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+19:3306:x1875449976242432:12345-0@lo:400:kworker.0 Request processed in 60us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568671.738071:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788568671.738113:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976242944 00000100:00100000:3.0:1788568671.738118:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976242944 00000100:00100000:3.0:1788568671.738160:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976242560 00000100:00100000:3.0:1788568671.738163:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976242560 00000100:00100000:3.0:1788568671.738175:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976242688 00000100:00100000:3.0:1788568671.738178:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976242688 00000100:00100000:3.0:1788568671.738193:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788568671.738207:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875449976242944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568671.738241:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875449976242944:12345-0@lo:400:kworker.0 Request processed in 35us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568671.738247:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788568671.738258:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788568671.738263:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976242560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568671.738289:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976242560:12345-0@lo:400:kworker.0 Request processed in 26us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568671.738294:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788568671.738304:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788568671.738310:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cce5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976242688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568671.738339:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cce5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976242688:12345-0@lo:400:kworker.0 Request processed in 30us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568671.738345:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788568671.738368:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976243072 00000100:00100000:3.0:1788568671.738371:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976243072 00000100:00100000:3.0:1788568671.738398:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976242816 00000100:00100000:3.0:1788568671.738401:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976242816 00000100:00100000:3.0:1788568671.738421:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788568671.738427:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cce5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976243072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568671.738458:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cce5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976243072:12345-0@lo:400:kworker.0 Request processed in 31us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568671.738464:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788568671.738475:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788568671.738481:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976242816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568671.738527:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976242816:12345-0@lo:400:kworker.0 Request processed in 46us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568671.738539:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1788568671.738570:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788568671.738574:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788568671.738577:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788568671.738640:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae251dc5500 x1875449976242816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568671.738656:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae251dc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976242816:0@lo:400:kworker.0 00000100:00100000:3.0:1788568671.738670:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae251dc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976242688:0@lo:400:kworker.0 00000100:00100000:3.0:1788568671.738727:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae28170b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976242560:0@lo:400:kworker.0 00010000:00080000:3.0:1788568671.738737:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae251dc5c00 x1875449976243072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568671.738747:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae251dc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976243072:0@lo:400:kworker.0 00000100:00100000:3.0:1788568671.738756:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae281708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976242432:0@lo:400:kworker.0 00000100:00100000:3.0:1788568671.738766:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae251dc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875449976242944:0@lo:400:kworker.0 00000100:00100000:3.0:1788568672.247189:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26f93dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976243200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788568672.247260:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568672.247292:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976243200 00000100:00100000:1.0:1788568672.247340:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976243200 00000100:00100000:1.0:1788568672.247396:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788568672.247407:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cce7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976243200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788568672.247439:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788568672.247701:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cce7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976243200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 294us (438us total) trans 0 rc 0/0 00010000:00080000:3.0:1788568672.247711:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae26f93dc00 x1875449976243200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568688 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568672.247711:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788568672.247733:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26f93dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976243200:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788568672.441356:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568672.776971:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976243328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788568672.777037:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568672.777111:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976243328 00000100:00100000:3.0:1788568672.777118:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976243328 00000100:00100000:3.0:1788568672.777163:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788568672.777171:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281708e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976243328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788568672.777204:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788568672.777247:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281708e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976243328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568672.777254:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1788568672.777307:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae27cce6d80 x1875449976243328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568688 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568672.777326:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976243328:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788568673.464024:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788568673.723179:0:11169:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdf0c1f720 20000000:00000080:0.0:1788568673.723199:0:11169:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ae2779ab000 uarg=0000000000000000 20000000:01000000:0.0:1788568673.723507:0:11169:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788568673.723513:0:11169:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788568673.723518:0:11169:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788568673.726773:0:11170:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1788568673.727449:0:11169:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788568673.738664:0:11169:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788568673.738693:0:11169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ae27feaa800/0x41e82f464b6a0e04 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568673.738711:0:11169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae2429de800/0x41e82f464b6a0da9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea0e expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568673.738720:0:11169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae282045600/0x41e82f464b6a0db7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0db0 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568673.738741:0:11169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae27feaa200/0x41e82f464b6a0dc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0dbe expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568673.738747:0:11169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae27feabc00/0x41e82f464b6a0dd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0dcc expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568673.738755:0:11169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0de8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea46 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568673.738763:0:11169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ae27feaa800/0x41e82f464b6a0e04 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568673.738802:0:11169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0de8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea46 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568673.738817:0:11169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0de8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea46 expref: 12 pid: 5836 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568673.738831:0:11169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26f93d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1875449976243456:192.168.206.4@tcp:104: 00010000:00010000:0.0:1788568673.739062:0:11169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae27feabc00/0x41e82f464b6a0dd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x41e82f464b6a0dcc expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568673.739071:0:11169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae27feabc00/0x41e82f464b6a0dd3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x41e82f464b6a0dcc expref: 18 pid: 5835 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568673.739081:0:11169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26f93d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1875449976243584:0@lo:104: 00000100:00100000:0.0:1788568673.739119:0:11169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788568673.739153:0:11169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae27feaa200/0x41e82f464b6a0dc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x41e82f464b6a0dbe expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568673.739167:0:11169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae27feaa200/0x41e82f464b6a0dc5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x41e82f464b6a0dbe expref: 18 pid: 5836 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568673.739176:0:11169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26f93fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1875449976243712:0@lo:104: 00000100:00100000:0.0:1788568673.739200:0:11169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788568673.739244:0:11169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae282045600/0x41e82f464b6a0db7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x41e82f464b6a0db0 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568673.739252:0:11169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae282045600/0x41e82f464b6a0db7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x41e82f464b6a0db0 expref: 18 pid: 5835 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568673.739260:0:11169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26f93ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1875449976243840:0@lo:104: 00000100:00100000:0.0:1788568673.739279:0:11169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788568673.739301:0:11169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae2429de800/0x41e82f464b6a0da9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea0e expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568673.739308:0:11169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae2429de800/0x41e82f464b6a0da9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea0e expref: 12 pid: 5836 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568673.739315:0:11169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277ac4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1875449976243968:192.168.206.4@tcp:104: 00000100:00100000:2.0:1788568673.739446:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976243584 00000100:00100000:2.0:1788568673.739453:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976243584 00000100:00100000:2.0:1788568673.739516:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976243712 00000100:00100000:2.0:1788568673.739520:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976243712 00000100:00100000:2.0:1788568673.739531:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976243840 00000100:00100000:2.0:1788568673.739533:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976243840 00000100:00100000:2.0:1788568673.739545:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788568673.739553:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:925db6b8-84bc-418c-b37a-40345c1020be+5:11169:x1875449976243584:12345-0@lo:104: 00010000:00010000:2.0:1788568673.739565:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.104@tcp lock: ffff9ae27feaa000/0x41e82f464b6a0dcc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0dd3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568673.739612:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788568673.739618:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:925db6b8-84bc-418c-b37a-40345c1020be+5:11169:x1875449976243584:12345-0@lo:104: Request processed in 67us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568673.739624:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788568673.739640:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788568673.739646:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:925db6b8-84bc-418c-b37a-40345c1020be+4:11169:x1875449976243712:12345-0@lo:104: 00010000:00010000:2.0:1788568673.739653:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.104@tcp lock: ffff9ae27feab600/0x41e82f464b6a0dbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0dc5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568673.739682:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788568673.739687:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:925db6b8-84bc-418c-b37a-40345c1020be+4:11169:x1875449976243712:12345-0@lo:104: Request processed in 42us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568673.739692:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788568673.739703:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788568673.739709:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:925db6b8-84bc-418c-b37a-40345c1020be+3:11169:x1875449976243840:12345-0@lo:104: 00010000:00010000:2.0:1788568673.739716:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.104@tcp lock: ffff9ae2429de600/0x41e82f464b6a0db0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0db7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568673.739746:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788568673.739757:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:925db6b8-84bc-418c-b37a-40345c1020be+3:11169:x1875449976243840:12345-0@lo:104: Request processed in 48us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568673.739762:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1788568673.739781:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788568673.739786:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae27feaa000/0x41e82f464b6a0dcc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0dd3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568673.739793:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaa000 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:2.0:1788568673.739797:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae27feaa000/0x41e82f464b6a0dcc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x41e82f464b6a0dd3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568673.739804:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae27feaa000/0x41e82f464b6a0dcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x41e82f464b6a0dd3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788568673.739810:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae27feaa000/0x41e82f464b6a0dcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x41e82f464b6a0dd3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788568673.739816:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788568673.739844:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae27feaa000/0x41e82f464b6a0dcc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0dd3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568673.739850:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788568673.739871:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae27feaa000/0x41e82f464b6a0dcc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0dd3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568673.739877:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae27feaa000/0x41e82f464b6a0dcc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0dd3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568673.739891:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788568673.739893:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae27feab600/0x41e82f464b6a0dbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0dc5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568673.739908:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feab600 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:2.0:1788568673.739911:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae27feab600/0x41e82f464b6a0dbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x41e82f464b6a0dc5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568673.739917:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae27feab600/0x41e82f464b6a0dbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x41e82f464b6a0dc5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788568673.739922:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae27feab600/0x41e82f464b6a0dbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x41e82f464b6a0dc5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788568673.739944:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788568673.739962:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae27feab600/0x41e82f464b6a0dbe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0dc5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568673.739966:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788568673.739972:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae27feab600/0x41e82f464b6a0dbe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0dc5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568673.739977:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae27feab600/0x41e82f464b6a0dbe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0dc5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568673.739985:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788568673.739988:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae2429de600/0x41e82f464b6a0db0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0db7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568673.739993:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429de600 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:2.0:1788568673.739995:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae2429de600/0x41e82f464b6a0db0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x41e82f464b6a0db7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568673.740010:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae2429de600/0x41e82f464b6a0db0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x41e82f464b6a0db7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788568673.740016:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae2429de600/0x41e82f464b6a0db0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x41e82f464b6a0db7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788568673.740020:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788568673.740032:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae2429de600/0x41e82f464b6a0db0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0db7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568673.740037:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788568673.740051:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae2429de600/0x41e82f464b6a0db0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0db7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568673.740057:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae2429de600/0x41e82f464b6a0db0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0db7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568673.740071:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568673.740072:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568673.740074:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568673.740080:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568673.740098:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976244096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788568673.740131:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568673.740153:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788568673.740158:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277d94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976244224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788568673.740176:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568673.740203:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277d95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:925db6b8-84bc-418c-b37a-40345c1020be:3308:1875449976244352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788568673.740222:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568673.740259:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976244096 00000100:00100000:2.0:1788568673.740264:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976244096 00010000:00010000:2.0:1788568673.740281:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae27feabc00/0x41e82f464b6a0dd3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0dcc expref: 19 pid: 5835 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568673.740300:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976244224 00000100:00100000:2.0:1788568673.740303:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976244224 00010000:00010000:2.0:1788568673.740312:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae27feaa200/0x41e82f464b6a0dc5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0dbe expref: 20 pid: 5836 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568673.740321:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976244352 00000100:00100000:2.0:1788568673.740323:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976244352 00010000:00010000:2.0:1788568673.740330:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae282045600/0x41e82f464b6a0db7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0db0 expref: 21 pid: 5835 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568673.740340:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788568673.740345:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25319c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:925db6b8-84bc-418c-b37a-40345c1020be+21:3306:x1875449976244096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788568673.740354:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568673.740359:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae27feabc00/0x41e82f464b6a0dd3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0dcc expref: 21 pid: 5835 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568673.740367:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae27feabc00/0x41e82f464b6a0dd3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x41e82f464b6a0dcc expref: 21 pid: 5835 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568673.740381:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568673.740407:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25319c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:925db6b8-84bc-418c-b37a-40345c1020be+21:3306:x1875449976244096:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568673.740413:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788568673.740444:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788568673.740450:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277d95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:925db6b8-84bc-418c-b37a-40345c1020be+20:3306:x1875449976244224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788568673.740464:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568673.740469:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae27feaa200/0x41e82f464b6a0dc5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0dbe expref: 20 pid: 5836 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568673.740476:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae27feaa200/0x41e82f464b6a0dc5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x41e82f464b6a0dbe expref: 20 pid: 5836 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568673.740498:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568673.740521:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277d95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:925db6b8-84bc-418c-b37a-40345c1020be+20:3306:x1875449976244224:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568673.740526:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788568673.740538:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788568673.740544:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277d94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:925db6b8-84bc-418c-b37a-40345c1020be+19:3308:x1875449976244352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788568673.740551:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568673.740555:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae282045600/0x41e82f464b6a0db7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0db0 expref: 19 pid: 5835 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568673.740562:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae282045600/0x41e82f464b6a0db7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x41e82f464b6a0db0 expref: 19 pid: 5835 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568673.740570:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568673.740594:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277d94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:925db6b8-84bc-418c-b37a-40345c1020be+19:3308:x1875449976244352:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568673.740599:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788568673.740635:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277d95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:925db6b8-84bc-418c-b37a-40345c1020be:3308:1875449976244352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788568673.740657:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277d94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976244224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788568673.740664:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976244096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788568673.741133:0:11169:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2669ad900 going to sleep for 11 seconds 00010000:00010000:0.0:1788568673.741155:0:11169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae27feabc00/0x41e82f464b6a0dd3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x41e82f464b6a0dcc expref: 18 pid: 5835 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568673.741166:0:11169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26f93d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1875449976243584:0@lo:104: 00010000:00010000:0.0:1788568673.741176:0:11169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae27feaa200/0x41e82f464b6a0dc5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x41e82f464b6a0dbe expref: 17 pid: 5836 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568673.741195:0:11169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26f93fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1875449976243712:0@lo:104: 00010000:00010000:0.0:1788568673.741219:0:11169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae282045600/0x41e82f464b6a0db7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x41e82f464b6a0db0 expref: 16 pid: 5835 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568673.741227:0:11169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26f93ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1875449976243840:0@lo:104: 00010000:00010000:2.0:1788568673.743919:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568673.748596:0:11169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26f93d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1875449976243456:192.168.206.4@tcp:104: 00000100:00100000:2.0:1788568673.748610:0:11169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277ac4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1875449976243968:192.168.206.4@tcp:104: 00010000:00010000:2.0:1788568673.748645:0:11169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ae27feaa800/0x41e82f464b6a0e04 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568673.750032:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568673.750244:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958381952 00000100:00100000:3.0:1788568673.750253:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958381952 00010000:00010000:3.0:1788568673.750291:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0de8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea46 expref: 13 pid: 5836 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568673.750327:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 28 00000100:00100000:3.0:1788568673.750336:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fa20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3f0f084e-5158-464d-a770-11379825208e+13:2364:x1875449958381952:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788568673.750349:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568673.750355:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0de8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea46 expref: 13 pid: 5836 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568673.750367:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0de8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea46 expref: 13 pid: 5836 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568673.750384:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0de8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea46 expref: 13 pid: 5836 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568673.750415:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788568673.750470:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fa20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3f0f084e-5158-464d-a770-11379825208e+12:2364:x1875449958381952:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 135us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568673.750489:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 28 00000100:00100000:1.0:1788568673.754013:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568673.754994:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958382080 00000100:00100000:3.0:1788568673.755063:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958382080 00010000:00010000:3.0:1788568673.755108:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae2429de800/0x41e82f464b6a0da9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea0e expref: 12 pid: 5836 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568673.755151:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 29 00000100:00100000:3.0:1788568673.755162:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fa23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f0f084e-5158-464d-a770-11379825208e+12:2363:x1875449958382080:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788568673.755176:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568673.755181:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae2429de800/0x41e82f464b6a0da9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea0e expref: 12 pid: 5836 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568673.755194:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae2429de800/0x41e82f464b6a0da9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea0e expref: 12 pid: 5836 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568673.755212:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae2429de800/0x41e82f464b6a0da9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea0e expref: 12 pid: 5836 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568673.755228:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ae27feaa800/0x41e82f464b6a0e04 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568673.755236:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae27feaa800/0x41e82f464b6a0e04 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568673.755250:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae27feaa800/0x41e82f464b6a0e04 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568673.755269:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae27feaa800/0x41e82f464b6a0e04 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568673.755276:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ae27feaa800/0x41e82f464b6a0e04 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568673.755282:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ae27feaa800/0x41e82f464b6a0e04 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568673.755289:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaa800 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788568673.755294:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ae27feaa800/0x41e82f464b6a0e04 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568673.755303:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ae27feaa800/0x41e82f464b6a0e04 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568673.755325:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ae27feaa800/0x41e82f464b6a0e04 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568673.755337:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788568673.755383:0:11169:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ae27feaa800/0x41e82f464b6a0e04 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568673.755393:0:11169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ae27feaa800/0x41e82f464b6a0e04 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568673.755395:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fa23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f0f084e-5158-464d-a770-11379825208e+11:2363:x1875449958382080:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 234us (1401us total) trans 0 rc 0/0 00010000:00010000:2.0:1788568673.755408:0:11169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae27feaa800/0x41e82f464b6a0e04 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568673.755410:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 29 00010000:00010000:3.0:1788568674.489342:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568674.834821:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568674.834867:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568674.835020:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568674.836205:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958382336 00000100:00100000:2.0:1788568674.836216:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958382336 00000100:00100000:2.0:1788568674.836273:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958382464 00000100:00100000:2.0:1788568674.836276:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958382464 00000100:00100000:2.0:1788568674.836297:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 92 00000100:00100000:2.0:1788568674.836305:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fa21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2364:x1875449958382336:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:2.0:1788568674.836378:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fa21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2364:x1875449958382336:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 73us (1566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568674.836385:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 92 00000100:00100000:2.0:1788568674.836399:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 93 00000100:00100000:2.0:1788568674.836405:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fa20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2364:x1875449958382464:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:2.0:1788568674.836436:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fa20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2364:x1875449958382464:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 31us (1417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568674.836453:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 93 00000100:00080000:1.0:1788568674.838038:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788568674.844417:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958382208 00000100:00100000:0.0:1788568674.844443:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958382208 00000100:00100000:0.0:1788568674.844521:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 229 00000100:00100000:0.0:1788568674.844533:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae250449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+11:2364:x1875449958382208:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:0.0:1788568674.844611:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae250449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+11:2364:x1875449958382208:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 81us (9743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568674.844618:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 229 00000100:00100000:1.0:1788568675.219377:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568675.219615:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958382592 00000100:00100000:3.0:1788568675.219627:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958382592 00000100:00100000:3.0:1788568675.219729:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 230 00000100:00100000:3.0:1788568675.219741:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+11:5603:x1875449958382592:12345-192.168.206.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788568675.219757:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568675.219789:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0e0b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bea70 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568675.219819:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0e0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea70 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568675.219831:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0e0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea70 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568675.219841:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429dee00, rc 0) 00000100:00100000:3.0:1788568675.219897:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+12:5603:x1875449958382592:12345-192.168.206.4@tcp:101:ll_cfg_requeue.0 Request processed in 159us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568675.219904:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 230 00000100:00100000:1.0:1788568675.229162:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568675.231651:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958382720 00000100:00100000:3.0:1788568675.231667:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958382720 00000100:00100000:3.0:1788568675.231744:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 231 00000100:00100000:3.0:1788568675.231754:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae250448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+12:5603:x1875449958382720:12345-192.168.206.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788568675.232070:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae250448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+12:5603:x1875449958382720:12345-192.168.206.4@tcp:501:ll_cfg_requeue.0 Request processed in 316us (2915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568675.232079:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 231 00000100:00100000:2.0:1788568675.234199:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568675.234445:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958382848 00000100:00100000:3.0:1788568675.234453:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958382848 00000100:00100000:3.0:1788568675.234552:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 232 00000100:00100000:3.0:1788568675.234565:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+12:5603:x1875449958382848:12345-192.168.206.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788568675.234772:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+12:5603:x1875449958382848:12345-192.168.206.4@tcp:503:ll_cfg_requeue.0 Request processed in 211us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568675.234780:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 232 00000100:00100000:3.0:1788568675.265358:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568675.265439:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958382976 00000100:00100000:0.0:1788568675.265449:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958382976 00000100:00100000:0.0:1788568675.265511:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 233 00000100:00100000:0.0:1788568675.265522:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae250448050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+12:5603:x1875449958382976:12345-192.168.206.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788568675.265538:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568675.265559:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae27feaa400/0x41e82f464b6a0e12 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bea77 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568675.265588:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae27feaa400/0x41e82f464b6a0e12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea77 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568675.265600:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae27feaa400/0x41e82f464b6a0e12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea77 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568675.265624:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae27feaa400, rc 0) 00000100:00100000:0.0:1788568675.265683:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae250448050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+13:5603:x1875449958382976:12345-192.168.206.4@tcp:101:ll_cfg_requeue.0 Request processed in 163us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568675.265691:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 233 00000100:00100000:2.0:1788568675.272559:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568675.272669:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958383104 00000100:00100000:3.0:1788568675.272679:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958383104 00000100:00100000:3.0:1788568675.272736:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 234 00000100:00100000:3.0:1788568675.272746:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+13:5603:x1875449958383104:12345-192.168.206.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788568675.273035:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+13:5603:x1875449958383104:12345-192.168.206.4@tcp:501:ll_cfg_requeue.0 Request processed in 290us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568675.273043:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 234 00000100:00100000:3.0:1788568675.274815:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568675.274904:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958383232 00000100:00100000:0.0:1788568675.274914:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958383232 00000100:00100000:0.0:1788568675.274995:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 235 00000100:00100000:0.0:1788568675.275005:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+13:5603:x1875449958383232:12345-192.168.206.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788568675.275207:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+13:5603:x1875449958383232:12345-192.168.206.4@tcp:503:ll_cfg_requeue.0 Request processed in 193us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568675.275216:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 235 00010000:00010000:1.0:1788568675.516159:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788568675.646081:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788568675.646088:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae277b92800 from 7 10000000:01000000:0.0:1788568675.646093:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788568675.646144:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae27feab000/0x41e82f464b6a0e19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568675.646154:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae27feab000/0x41e82f464b6a0e19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568675.646164:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae27feab000/0x41e82f464b6a0e19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568675.646188:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277ac4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976244480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788568675.646261:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568675.646314:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae26f8e1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788568675.646352:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976244480 00000100:00100000:0.0:1788568675.646359:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976244480 00000100:00100000:0.0:1788568675.646402:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788568675.646410:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+16:5838:x1875449976244480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788568675.646424:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568675.646436:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae27feabc00/0x41e82f464b6a0e20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0e19 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568675.646459:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae27feabc00/0x41e82f464b6a0e20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0e19 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568675.646483:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae27feabc00/0x41e82f464b6a0e20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0e19 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568675.646491:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae27feabc00, rc 0) 00000100:00100000:0.0:1788568675.646528:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+17:5838:x1875449976244480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568675.646534:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788568675.646578:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277ac4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976244480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788568675.646592:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae27feab000/0x41e82f464b6a0e19 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0e20 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568675.646600:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae27feab000/0x41e82f464b6a0e19 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0e20 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568675.646646:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277ac4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976244608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788568675.646671:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568675.646688:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae26f8e1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788568675.646705:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976244608 00000100:00100000:0.0:1788568675.646709:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976244608 00000100:00100000:0.0:1788568675.646731:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788568675.646737:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+17:5838:x1875449976244608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788568675.646985:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+17:5838:x1875449976244608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 246us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568675.646992:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788568675.647021:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277ac4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976244608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788568675.647048:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277ac4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976244736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788568675.647083:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568675.647096:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae26f8e1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788568675.647107:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976244736 00000100:00100000:0.0:1788568675.647110:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976244736 00000100:00100000:0.0:1788568675.647130:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788568675.647136:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+17:5838:x1875449976244736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788568675.647265:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+17:5838:x1875449976244736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568675.647271:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788568675.647309:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277ac4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976244736:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788568675.649101:0:11217:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788568675.649299:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788568675.649319:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788568675.649329:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae27feab000/0x41e82f464b6a0e19 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0e20 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568675.649341:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae27feab000/0x41e82f464b6a0e19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0e20 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788568675.649353:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788568675.649356:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae27bf74800 from 7 10000000:01000000:2.0:1788568675.649359:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788568675.649577:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7be00/0x41e82f464b6a0e27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568675.649586:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae252e7be00/0x41e82f464b6a0e27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568675.649597:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae252e7be00/0x41e82f464b6a0e27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568675.649624:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277d95c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976244864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788568675.649686:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568675.649719:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae142aba9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788568675.650849:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976244864 00000100:00100000:2.0:1788568675.650860:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976244864 00000100:00100000:2.0:1788568675.650923:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788568675.650959:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+17:5838:x1875449976244864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788568675.650975:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568675.650989:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae252e7a800/0x41e82f464b6a0e2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0e27 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568675.651015:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae252e7a800/0x41e82f464b6a0e2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0e27 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568675.651026:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae252e7a800/0x41e82f464b6a0e2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0e27 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568675.651034:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7a800, rc 0) 00000100:00100000:2.0:1788568675.651095:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+18:5838:x1875449976244864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (1408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568675.651102:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788568675.651151:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277d95c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976244864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788568675.651169:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae252e7be00/0x41e82f464b6a0e27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0e2e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568675.651177:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae252e7be00/0x41e82f464b6a0e27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0e2e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568675.651246:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277d95c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976244992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788568675.651277:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568675.651302:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae142aba9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788568675.651315:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976244992 00000100:00100000:2.0:1788568675.651318:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976244992 00000100:00100000:2.0:1788568675.651339:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788568675.651353:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+18:5838:x1875449976244992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788568675.651610:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+18:5838:x1875449976244992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 258us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568675.651618:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788568675.651648:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277d95c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976244992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788568675.651676:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277d95c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976245120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788568675.651714:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568675.651728:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae142aba9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788568675.651738:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976245120 00000100:00100000:2.0:1788568675.651741:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976245120 00000100:00100000:2.0:1788568675.651760:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788568675.651766:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+18:5838:x1875449976245120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788568675.651896:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+18:5838:x1875449976245120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568675.651904:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788568675.651962:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277d95c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976245120:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788568675.654822:0:11218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788568675.654891:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788568675.654907:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788568675.654917:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7be00/0x41e82f464b6a0e27 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0e2e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568675.654942:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae252e7be00/0x41e82f464b6a0e27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0e2e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788568675.654954:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788568675.654963:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae26b352000 from 7 10000000:01000000:2.0:1788568675.654966:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788568675.655000:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7ae00/0x41e82f464b6a0e35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568675.655007:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae252e7ae00/0x41e82f464b6a0e35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568675.655017:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae252e7ae00/0x41e82f464b6a0e35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568675.655042:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277d95c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976245248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788568675.655103:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568675.655135:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae142abaf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788568675.655153:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976245248 00000100:00100000:2.0:1788568675.655159:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976245248 00000100:00100000:2.0:1788568675.656091:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788568675.656108:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+18:5838:x1875449976245248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788568675.656121:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568675.656134:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae252e7a400/0x41e82f464b6a0e3c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0e35 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568675.656157:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae252e7a400/0x41e82f464b6a0e3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0e35 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568675.656168:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae252e7a400/0x41e82f464b6a0e3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0e35 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568675.656175:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7a400, rc 0) 00000100:00100000:2.0:1788568675.656561:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+19:5838:x1875449976245248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 457us (1456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568675.657021:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277d95c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976245248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788568675.657042:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae252e7ae00/0x41e82f464b6a0e35 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0e3c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568675.657058:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae252e7ae00/0x41e82f464b6a0e35 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0e3c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568675.657131:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277ac4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976245376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788568675.657169:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568675.657207:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae26f8e1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788568675.657223:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976245376 00000100:00100000:0.0:1788568675.657228:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976245376 00000100:00100000:2.0:1788568675.658538:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788568675.660904:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788568675.660949:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+19:5838:x1875449976245376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788568675.661256:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+19:5838:x1875449976245376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 339us (4085us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568675.661265:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788568675.661685:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277ac4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976245376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788568675.661736:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26fa20a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976245504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788568675.661784:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568675.671261:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27fd4d780 going to sleep for 11 seconds 00000100:00100000:3.0:1788568675.671608:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976245504 00000100:00100000:3.0:1788568675.671617:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976245504 00000100:00100000:3.0:1788568675.671666:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788568675.671675:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+19:5838:x1875449976245504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788568675.671893:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+19:5838:x1875449976245504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 218us (10108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568675.671900:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788568675.672019:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26fa20a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976245504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788568675.672768:0:11221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788568675.673017:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788568675.673036:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788568675.673046:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7ae00/0x41e82f464b6a0e35 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0e3c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568675.673056:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae252e7ae00/0x41e82f464b6a0e35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0e3c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568676.535262:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568676.863548:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26fa20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925db6b8-84bc-418c-b37a-40345c1020be:3309:1875449976245632:0@lo:400:kworker.0 00000100:00100000:2.0:1788568676.863610:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568676.863658:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26fa23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875449976246144:0@lo:400:kworker.0 00000100:00100000:2.0:1788568676.863685:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568676.863709:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788568676.863715:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26fa21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976246016:0@lo:400:kworker.0 00000100:00100000:2.0:1788568676.863737:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568676.863760:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26fa20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976245760:0@lo:400:kworker.0 00000100:00100000:2.0:1788568676.863783:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568676.863798:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26fa22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976246272:0@lo:400:kworker.0 00000100:00100000:2.0:1788568676.863818:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568676.863833:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788568676.863838:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26fa20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875449976245888:0@lo:400:kworker.0 00000100:00100000:2.0:1788568676.863855:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568676.863884:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976246144 00000100:00100000:2.0:1788568676.863892:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976246144 00000100:00100000:2.0:1788568676.863959:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976245760 00000100:00100000:2.0:1788568676.863962:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976245760 00000100:00100000:2.0:1788568676.863973:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976245888 00000100:00100000:2.0:1788568676.863976:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976245888 00000100:00100000:2.0:1788568676.863994:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788568676.864001:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277d94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875449976246144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568676.864049:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277d94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875449976246144:12345-0@lo:400:kworker.0 Request processed in 48us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568676.864070:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788568676.864087:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788568676.864093:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277d96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976245760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568676.864125:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277d96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976245760:12345-0@lo:400:kworker.0 Request processed in 33us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568676.864131:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788568676.864143:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788568676.864149:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277d97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875449976245888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568676.864174:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277d97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875449976245888:12345-0@lo:400:kworker.0 Request processed in 26us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568676.864180:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:2.0:1788568676.864216:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788568676.864241:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26fa20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875449976245888:0@lo:400:kworker.0 00000100:00100000:2.0:1788568676.864252:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26fa20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976245760:0@lo:400:kworker.0 00000100:00100000:2.0:1788568676.864279:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26fa23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875449976246144:0@lo:400:kworker.0 00000100:00100000:1.0:1788568676.864411:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976245632 00000100:00100000:1.0:1788568676.864416:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976245632 00000100:00100000:1.0:1788568676.864455:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788568676.864473:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+19:3309:x1875449976245632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568676.864511:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+19:3309:x1875449976245632:12345-0@lo:400:kworker.0 Request processed in 50us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568676.864524:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788568676.864614:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976246016 00000100:00100000:3.0:1788568676.864619:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976246016 00000100:00100000:3.0:1788568676.864660:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976246272 00000100:00100000:3.0:1788568676.864663:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976246272 00000100:00100000:3.0:1788568676.864684:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788568676.864691:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976246016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568676.864727:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976246016:12345-0@lo:400:kworker.0 Request processed in 37us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568676.864733:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788568676.864745:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788568676.864760:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976246272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568676.864794:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976246272:12345-0@lo:400:kworker.0 Request processed in 37us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568676.864800:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1788568676.864839:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae26fa22d80 x1875449976246272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568676.864851:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26fa22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976246272:0@lo:400:kworker.0 00000100:00080000:1.0:1788568676.865340:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788568676.865345:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788568676.865590:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae26fa21500 x1875449976246016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568676.865603:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26fa21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976246016:0@lo:400:kworker.0 00000100:00100000:2.0:1788568676.865613:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26fa20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925db6b8-84bc-418c-b37a-40345c1020be:3309:1875449976245632:0@lo:400:kworker.0 00000100:00100000:1.0:1788568677.372361:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277ac6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976246400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788568677.372424:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568677.372577:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976246400 00000100:00100000:0.0:1788568677.372585:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976246400 00000100:00100000:0.0:1788568677.372635:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788568677.372644:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fa20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976246400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788568677.372679:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788568677.372734:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fa20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976246400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568677.372740:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1788568677.372856:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae277ac6a00 x1875449976246400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568693 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568677.372877:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277ac6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976246400:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788568677.562826:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568677.879571:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788568677.879599:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277ac6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976246528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788568677.879665:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568677.879729:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976246528 00000100:00100000:0.0:1788568677.879737:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976246528 00000100:00100000:0.0:1788568677.879780:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788568677.879790:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277ac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976246528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788568677.879837:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788568677.879885:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277ac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976246528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568677.879893:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1788568677.879962:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae277ac6d80 x1875449976246528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568693 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568677.879979:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277ac6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976246528:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788568678.362134:0:11368:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg604-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788568678.583119:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568679.608677:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568679.956321:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568679.956381:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568679.956455:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568679.957088:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958383616 00000100:00100000:3.0:1788568679.957102:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958383616 00000100:00100000:3.0:1788568679.957198:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958383488 00000100:00100000:3.0:1788568679.957202:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958383488 00000100:00100000:3.0:1788568679.957247:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 97 00000100:00100000:3.0:1788568679.957259:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277d95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2362:x1875449958383616:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:3.0:1788568679.957367:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277d95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2362:x1875449958383616:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 110us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568679.957375:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 97 00000100:00100000:3.0:1788568679.957403:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 98 00000100:00100000:3.0:1788568679.957413:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277d94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2362:x1875449958383488:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:3.0:1788568679.957439:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277d94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2362:x1875449958383488:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 29us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568679.957457:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 98 00000100:00080000:2.0:1788568679.958588:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788568679.960529:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958383360 00000100:00100000:0.0:1788568679.960544:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958383360 00000100:00100000:0.0:1788568679.960622:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 246 00000100:00100000:0.0:1788568679.960633:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+13:2362:x1875449958383360:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:0.0:1788568679.960718:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+13:2362:x1875449958383360:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 86us (4412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568679.960726:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 246 00010000:00010000:0.0:1788568680.634521:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568681.655380:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568681.977883:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26f93d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976246784:0@lo:400:kworker.0 00000100:00100000:2.0:1788568681.977892:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26f93ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875449976246912:0@lo:400:kworker.0 00000100:00100000:2.0:1788568681.978008:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568681.978049:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976246912 00000100:00100000:0.0:1788568681.978061:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976246912 00000100:00100000:2.0:1788568681.978092:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788568681.978099:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976247296:0@lo:400:kworker.0 00000100:00100000:2.0:1788568681.978130:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568681.978143:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788568681.978158:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875449976246912:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788568681.978167:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788568681.978181:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976247296 00000100:00100000:2.0:1788568681.978185:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976247296 00000100:00100000:2.0:1788568681.978228:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788568681.978241:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fec5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976247296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568681.978242:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875449976246912:12345-0@lo:400:kworker.0 Request processed in 85us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568681.978255:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788568681.978282:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fec5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976247296:12345-0@lo:400:kworker.0 Request processed in 47us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568681.978290:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1788568681.978311:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788568681.978337:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae27fec4000 x1875449976247296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568681.978353:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976247296:0@lo:400:kworker.0 00000100:00100000:0.0:1788568681.978497:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568681.978538:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976246784 00000100:00100000:0.0:1788568681.978658:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976246784 00000100:00100000:0.0:1788568681.978684:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788568681.978690:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976246784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568681.978730:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976246784:12345-0@lo:400:kworker.0 Request processed in 39us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568681.978737:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788568681.978766:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26f93d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976246784:0@lo:400:kworker.0 00000100:00100000:3.0:1788568681.978856:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925db6b8-84bc-418c-b37a-40345c1020be:3309:1875449976246656:0@lo:400:kworker.0 00000100:00100000:3.0:1788568681.978897:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568681.979014:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26f93d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875449976247168:0@lo:400:kworker.0 00000100:00100000:3.0:1788568681.979043:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568681.979066:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788568681.979074:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26f93fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976247040:0@lo:400:kworker.0 00000100:00100000:2.0:1788568681.979077:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26f93ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875449976246912:0@lo:400:kworker.0 00000100:00100000:3.0:1788568681.979107:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568681.979195:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976246656 00000100:00100000:0.0:1788568681.979200:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976246656 00000100:00100000:2.0:1788568681.979247:0:8111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976247040 00000100:00100000:2.0:1788568681.979252:0:8111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976247040 00000100:00100000:0.0:1788568681.979278:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788568681.979289:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+19:3309:x1875449976246656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568681.979295:0:8111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788568681.979305:0:8111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cce6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976247040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568681.979353:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+19:3309:x1875449976246656:12345-0@lo:400:kworker.0 Request processed in 67us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568681.979360:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788568681.979452:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976247168 00000100:00100000:1.0:1788568681.979457:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976247168 00000100:00100000:1.0:1788568681.979485:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788568681.979492:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae28170b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875449976247168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568681.979546:0:8111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cce6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976247040:12345-0@lo:400:kworker.0 Request processed in 243us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568681.979564:0:8111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1788568681.979583:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788568681.979587:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788568681.979624:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae26f93fb80 x1875449976247040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568681.979635:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26f93fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976247040:0@lo:400:kworker.0 00000100:00100000:2.0:1788568681.979644:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925db6b8-84bc-418c-b37a-40345c1020be:3309:1875449976246656:0@lo:400:kworker.0 00000100:00100000:1.0:1788568681.984743:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae28170b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875449976247168:12345-0@lo:400:kworker.0 Request processed in 5234us (5681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568681.984764:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788568681.990836:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26f93d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875449976247168:0@lo:400:kworker.0 00000100:00100000:2.0:1788568682.489350:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976247424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788568682.489455:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568682.489603:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976247424 00000100:00100000:3.0:1788568682.489613:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976247424 00000100:00100000:3.0:1788568682.489683:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788568682.489705:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fec4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976247424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788568682.489753:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788568682.489813:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fec4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976247424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568682.489821:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1788568682.490077:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae27cce6d80 x1875449976247424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568698 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568682.490101:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976247424:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788568682.679187:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788568682.866327:0:11467:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 20:38:00 (1788568680) === 00000100:00100000:3.0:1788568683.001286:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26fa21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976247552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788568683.001363:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568683.002668:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976247552 00000100:00100000:0.0:1788568683.002681:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976247552 00000100:00100000:0.0:1788568683.002743:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788568683.002753:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976247552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788568683.002791:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788568683.002853:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976247552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (1490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568683.002859:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1788568683.002894:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788568683.002945:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae26fa21500 x1875449976247552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568699 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568683.002965:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26fa21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976247552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788568683.083132:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568683.083179:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568683.083262:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958383744 00000100:00100000:0.0:1788568683.083273:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958383744 00000100:00100000:0.0:1788568683.083354:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 14 00000100:00100000:0.0:1788568683.083366:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2364:x1875449958383744:12345-192.168.206.4@tcp:41:mkdir.0 00000100:00100000:1.0:1788568683.083367:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958383872 00000100:00100000:1.0:1788568683.083372:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958383872 00000100:00100000:1.0:1788568683.083396:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 0 00000100:00100000:1.0:1788568683.083402:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:27f83c0c-e36b-48ce-9485-80051fd252dc+7:9689:x1875449958383872:12345-192.168.206.4@tcp:700:mkdir.0 00000004:00000024:0.0:1788568683.083407:0:5842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:2.0:1788568683.083498:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788568683.083594:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:27f83c0c-e36b-48ce-9485-80051fd252dc+7:9689:x1875449958383872:12345-192.168.206.4@tcp:700:mkdir.0 Request processed in 190us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568683.083619:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 0 00000100:00100000:0.0:1788568683.085947:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2364:x1875449958383744:12345-192.168.206.4@tcp:41:mkdir.0 Request processed in 2553us (2736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568683.085961:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 14 00000100:00100000:2.0:1788568683.093477:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568683.093572:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958384128 00000100:00100000:1.0:1788568683.093581:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958384128 00000100:00100000:1.0:1788568683.093636:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 15 00000100:00100000:1.0:1788568683.093645:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277d95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+6:9689:x1875449958384128:12345-192.168.206.4@tcp:36:mkdir.0 00010000:00010000:1.0:1788568683.093711:0:6714:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788568683.093779:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b800/0x41e82f464b6a0d24 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9be9f9 expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.093799:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae255fb9d00) 00010000:00010000:1.0:1788568683.093809:0:6714:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788568683.094486:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045600/0x41e82f464b6a0e43 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.094502:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045600/0x41e82f464b6a0e43 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.094512:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045600/0x41e82f464b6a0e43 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.094538:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0e4a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.094546:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0e4a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.094553:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0e4a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568683.108425:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788568683.108461:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045600/0x41e82f464b6a0e43 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.108472:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045600/0x41e82f464b6a0e43 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.108480:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045600/0x41e82f464b6a0e43 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.108502:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae282045600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568683.108507:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045600/0x41e82f464b6a0e43 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.108515:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045600/0x41e82f464b6a0e43 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.108532:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae25820ce00) 00010000:00010000:1.0:1788568683.108535:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568683.108540:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045600/0x41e82f464b6a0e43 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.108546:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045600/0x41e82f464b6a0e43 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788568683.108569:0:6714:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000034db81fa reply state 00000000404795b1 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0e4a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568683.108577:0:6714:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788568683.108681:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277d95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+7:9689:x1875449958384128:12345-192.168.206.4@tcp:36:mkdir.0 Request processed in 15032us (15207us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788568683.108690:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 15 00010000:00010000:0.0:1788568683.113680:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0e4a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.113711:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0e4a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.113719:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0e4a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.113725:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae282044000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568683.113729:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0e4a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.113736:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0e4a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.113759:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ae25820c700) 00010000:00010000:0.0:1788568683.113762:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788568683.113766:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0e4a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.113772:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0e4a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568683.147721:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568683.148085:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958384256 00000100:00100000:3.0:1788568683.148099:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958384256 00000100:00100000:3.0:1788568683.148303:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 16 00000100:00100000:3.0:1788568683.148317:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b567800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+6:9690:x1875449958384256:12345-192.168.206.4@tcp:101:chmod.0 00010000:00010000:3.0:1788568683.148347:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568683.148458:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a0e51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bea7e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568683.148573:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a0e58 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568683.148592:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a0e58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568683.148608:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a0e58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788568683.148657:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788568683.148662:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788568683.148710:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a0e58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568683.149121:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a0e51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea7e expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568683.149565:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a0e58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea7e expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568683.149577:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae2430adb00) 00010000:00010000:3.0:1788568683.149580:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788568683.149585:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429dfe00, rc 0) 00000100:00100000:3.0:1788568683.149753:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b567800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+7:9690:x1875449958384256:12345-192.168.206.4@tcp:101:chmod.0 Request processed in 1438us (2045us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568683.149763:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 16 00000100:00100000:2.0:1788568683.166178:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568683.166303:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958384512 00000100:00100000:0.0:1788568683.166315:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958384512 00000100:00100000:0.0:1788568683.166392:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 17 00000100:00100000:0.0:1788568683.166405:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b564a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+7:9690:x1875449958384512:12345-192.168.206.4@tcp:36:chmod.0 00010000:00010000:0.0:1788568683.166485:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568683.166520:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a0e58 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea7e expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.166547:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae2430adb00) 00010000:00010000:0.0:1788568683.166563:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788568683.166598:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa000/0x41e82f464b6a0e5f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.166734:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa000/0x41e82f464b6a0e5f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.167883:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa000/0x41e82f464b6a0e5f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788568683.168307:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009e49367d reply state 000000001a66dbef transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa000/0x41e82f464b6a0e5f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568683.168319:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788568683.168330:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788568683.168464:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b564a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+8:9690:x1875449958384512:12345-192.168.206.4@tcp:36:chmod.0 Request processed in 2057us (2295us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788568683.168473:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 17 00010000:00010000:0.0:1788568683.173035:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa000/0x41e82f464b6a0e5f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.173074:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa000/0x41e82f464b6a0e5f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.173084:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa000/0x41e82f464b6a0e5f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.173089:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaa000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568683.173094:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa000/0x41e82f464b6a0e5f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.173102:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa000/0x41e82f464b6a0e5f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.173122:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae24515a800) 00010000:00010000:0.0:1788568683.173125:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788568683.173131:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa000/0x41e82f464b6a0e5f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.173137:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa000/0x41e82f464b6a0e5f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568683.207653:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568683.208314:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958384640 00000100:00100000:0.0:1788568683.208330:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958384640 00000100:00100000:0.0:1788568683.208498:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 18 00000100:00100000:0.0:1788568683.208511:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b565c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+7:9691:x1875449958384640:12345-192.168.206.4@tcp:101:chown.0 00010000:00010000:0.0:1788568683.208544:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568683.208580:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa000/0x41e82f464b6a0e66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bea85 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.208668:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a0e6d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.208699:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a0e6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.208714:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a0e6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788568683.208761:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788568683.208766:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788568683.208816:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a0e6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.208847:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa000/0x41e82f464b6a0e66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea85 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.208872:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a0e6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea85 expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.208883:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae24515a800) 00010000:00010000:0.0:1788568683.208887:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788568683.208891:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae27feabe00, rc 0) 00000100:00100000:0.0:1788568683.209012:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b565c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+8:9691:x1875449958384640:12345-192.168.206.4@tcp:101:chown.0 Request processed in 503us (1375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568683.209021:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 18 00000100:00100000:2.0:1788568683.214145:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568683.214912:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958384768 00000100:00100000:1.0:1788568683.214960:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958384768 00000100:00100000:1.0:1788568683.215025:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 19 00000100:00100000:1.0:1788568683.215036:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b565500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+8:9691:x1875449958384768:12345-192.168.206.4@tcp:101:chown.0 00010000:00010000:1.0:1788568683.215057:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568683.215077:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045600/0x41e82f464b6a0e74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bea8c expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.215173:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0e7b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.215187:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0e7b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.215198:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0e7b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.215211:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044e00/0x41e82f464b6a0e82 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.215218:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044e00/0x41e82f464b6a0e82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.215224:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044e00/0x41e82f464b6a0e82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.215309:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044800/0x41e82f464b6a0e89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.215317:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044800/0x41e82f464b6a0e89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.215325:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044800/0x41e82f464b6a0e89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568683.215356:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788568683.215360:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788568683.215381:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044800/0x41e82f464b6a0e89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.215403:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0e7b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.215410:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0e7b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.215416:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0e7b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.215421:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae282044000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568683.215425:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0e7b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.215445:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0e7b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.215457:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae24515a800) 00010000:00010000:1.0:1788568683.215460:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568683.215464:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0e7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.215470:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0e7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.215482:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044e00/0x41e82f464b6a0e82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.215489:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044e00/0x41e82f464b6a0e82 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.215494:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044e00/0x41e82f464b6a0e82 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.215506:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae282044e00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568683.215509:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044e00/0x41e82f464b6a0e82 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.215515:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044e00/0x41e82f464b6a0e82 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.215523:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ae25820ce00) 00010000:00010000:1.0:1788568683.215526:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568683.215528:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044e00/0x41e82f464b6a0e82 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.215534:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044e00/0x41e82f464b6a0e82 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.215564:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045600/0x41e82f464b6a0e74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea8c expref: 10 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.215577:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044800/0x41e82f464b6a0e89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea8c expref: 9 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.215585:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ae25820ca00) 00010000:00010000:1.0:1788568683.215587:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788568683.215589:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae282044800, rc 0) 00000100:00100000:1.0:1788568683.215663:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b565500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+9:9691:x1875449958384768:12345-192.168.206.4@tcp:101:chown.0 Request processed in 628us (1527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568683.215670:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 19 00000100:00100000:2.0:1788568683.220377:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568683.220547:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958385024 00000100:00100000:3.0:1788568683.220564:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958385024 00000100:00100000:3.0:1788568683.220668:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 20 00000100:00100000:3.0:1788568683.220682:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b565880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+9:9691:x1875449958385024:12345-192.168.206.4@tcp:36:chown.0 00010000:00010000:3.0:1788568683.220766:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568683.220802:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044800/0x41e82f464b6a0e89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea8c expref: 9 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568683.220826:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ae25820ca00) 00010000:00010000:3.0:1788568683.220840:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788568683.220874:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a0e90 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568683.220901:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a0e90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568683.220913:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a0e90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788568683.274331:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eac81cbd reply state 000000006d2e5206 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a0e90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568683.274348:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788568683.274362:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788568683.274479:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b565880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+10:9691:x1875449958385024:12345-192.168.206.4@tcp:36:chown.0 Request processed in 53795us (54107us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788568683.274502:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 20 00000001:00080000:0.0:1788568683.274539:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:0.0:1788568683.274558:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:0.0:1788568683.274572:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a0e90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.274581:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a0e90 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.274589:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a0e90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.274594:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429de800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568683.274598:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a0e90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.274605:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a0e90 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.274620:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ae2430ade00) 00010000:00010000:0.0:1788568683.274624:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788568683.274629:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a0e90 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.274647:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a0e90 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568683.285733:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568683.285973:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958385152 00000100:00100000:1.0:1788568683.286000:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958385152 00000100:00100000:1.0:1788568683.286064:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 21 00000100:00100000:1.0:1788568683.286076:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+6:9692:x1875449958385152:12345-192.168.206.4@tcp:101:touch.500 00010000:00010000:1.0:1788568683.286098:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568683.286118:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045600/0x41e82f464b6a0e97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bea93 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788568683.287737:0:5844:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1466us 00010000:00010000:2.0:1788568683.318537:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a0e9e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.318574:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a0e9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.318587:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a0e9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.318603:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a0ea5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.318610:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a0ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.318616:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a0ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.319680:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b800/0x41e82f464b6a0eac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.319694:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b800/0x41e82f464b6a0eac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.319705:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b800/0x41e82f464b6a0eac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788568683.319734:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788568683.319738:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788568683.319778:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b800/0x41e82f464b6a0eac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.319791:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a0e9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.319807:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a0e9e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.319813:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a0e9e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.319819:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7b200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568683.319824:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a0e9e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.319831:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a0e9e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.319854:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae24515a800) 00010000:00010000:2.0:1788568683.319857:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788568683.319862:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a0e9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.319868:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a0e9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.319879:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a0ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.319886:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a0ea5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.319891:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a0ea5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.319896:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7b600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568683.319906:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a0ea5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.319911:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a0ea5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.319919:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ae255fb9000) 00010000:00010000:2.0:1788568683.319922:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788568683.319951:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a0ea5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.319959:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a0ea5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.320000:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045600/0x41e82f464b6a0e97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea93 expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.320017:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b800/0x41e82f464b6a0eac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea93 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.320024:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ae255fb9d00) 00010000:00010000:2.0:1788568683.320026:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788568683.320029:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7b800, rc 0) 00000100:00100000:2.0:1788568683.320109:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+7:9692:x1875449958385152:12345-192.168.206.4@tcp:101:touch.500 Request processed in 34034us (34388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568683.320119:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 21 00000100:00100000:3.0:1788568683.326008:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568683.326303:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958385408 00000100:00100000:0.0:1788568683.326313:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958385408 00000100:00100000:0.0:1788568683.326373:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 22 00000100:00100000:0.0:1788568683.326399:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+7:9692:x1875449958385408:12345-192.168.206.4@tcp:101:touch.500 00010000:00010000:0.0:1788568683.326424:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568683.326460:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa000/0x41e82f464b6a0eb3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bea9a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.327513:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044e00/0x41e82f464b6a0eba lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.327534:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044e00/0x41e82f464b6a0eba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.327546:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044e00/0x41e82f464b6a0eba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.327603:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0ec1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.327612:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0ec1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.327618:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0ec1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788568683.328594:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1788568683.328859:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044800/0x41e82f464b6a0ec8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.328874:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044800/0x41e82f464b6a0ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.328891:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044800/0x41e82f464b6a0ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.328964:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044e00/0x41e82f464b6a0eba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.328972:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044e00/0x41e82f464b6a0eba lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.328980:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044e00/0x41e82f464b6a0eba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.328987:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae282044e00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568683.328992:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044e00/0x41e82f464b6a0eba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.329000:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044e00/0x41e82f464b6a0eba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.329013:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ae255fb9d00) 00010000:00010000:1.0:1788568683.329016:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568683.329021:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044e00/0x41e82f464b6a0eba lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.329028:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044e00/0x41e82f464b6a0eba lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788568683.329042:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000067e5c133 reply state 000000003b879ae8 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0ec1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568683.329052:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788568683.329106:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa000/0x41e82f464b6a0eb3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea9a expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.329122:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044800/0x41e82f464b6a0ec8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea9a expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.329131:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ae25820c800) 00010000:00010000:1.0:1788568683.329133:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788568683.329136:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae282044800, rc 0) 00000100:00100000:1.0:1788568683.331123:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+10:9692:x1875449958385408:12345-192.168.206.4@tcp:101:touch.500 Request processed in 4716us (5114us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788568683.331134:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 22 00010000:00010000:0.0:1788568683.335271:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0ec1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.335287:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0ec1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.335295:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0ec1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.335301:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae282044000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568683.335305:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0ec1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.335312:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0ec1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.335327:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x2f2003ca (ffff9ae25820ce00) 00010000:00010000:0.0:1788568683.335330:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788568683.335335:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0ec1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.335341:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0ec1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568683.336324:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568683.340623:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958385664 00000100:00100000:0.0:1788568683.340637:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958385664 00000100:00100000:0.0:1788568683.340714:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 23 00000100:00100000:0.0:1788568683.340723:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+9:9692:x1875449958385664:12345-192.168.206.4@tcp:36:touch.500 00010000:00010000:0.0:1788568683.340775:0:6714:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568683.340799:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044800/0x41e82f464b6a0ec8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea9a expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.340819:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ae25820c800) 00010000:00010000:0.0:1788568683.340830:0:6714:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788568683.340887:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab600/0x41e82f464b6a0ed6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.340901:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab600/0x41e82f464b6a0ed6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.340911:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab600/0x41e82f464b6a0ed6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788568683.341052:0:6714:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000030980128 reply state 00000000566db655 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab600/0x41e82f464b6a0ed6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568683.341062:0:6714:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788568683.341182:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+10:9692:x1875449958385664:12345-192.168.206.4@tcp:36:touch.500 Request processed in 459us (4865us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788568683.341189:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 23 00000100:00100000:3.0:1788568683.343206:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568683.343465:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958385792 00000100:00100000:1.0:1788568683.343477:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958385792 00000100:00100000:1.0:1788568683.343532:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 24 00000100:00100000:1.0:1788568683.343543:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+10:9692:x1875449958385792:12345-192.168.206.4@tcp:101:touch.500 00010000:00010000:1.0:1788568683.343565:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568683.343584:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044e00/0x41e82f464b6a0edd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beaa1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.343647:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044e00/0x41e82f464b6a0edd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beaa1 expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.343663:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044e00/0x41e82f464b6a0edd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beaa1 expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.343682:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ae24515a500) 00010000:00010000:1.0:1788568683.343686:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788568683.343702:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae282044e00, rc 0) 00000100:00100000:1.0:1788568683.343767:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+11:9692:x1875449958385792:12345-192.168.206.4@tcp:101:touch.500 Request processed in 225us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568683.343776:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 24 00010000:00010000:0.0:1788568683.344360:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab600/0x41e82f464b6a0ed6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.344370:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab600/0x41e82f464b6a0ed6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.344377:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab600/0x41e82f464b6a0ed6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.344391:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feab600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568683.344396:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab600/0x41e82f464b6a0ed6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.344405:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab600/0x41e82f464b6a0ed6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.344418:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ae24515a500) 00010000:00010000:0.0:1788568683.344421:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788568683.344425:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab600/0x41e82f464b6a0ed6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.344443:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab600/0x41e82f464b6a0ed6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568683.353023:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568683.353108:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958385920 00000100:00100000:0.0:1788568683.353117:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958385920 00000100:00100000:0.0:1788568683.353168:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 16 00000100:00100000:0.0:1788568683.353177:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fa22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1875449958385920:12345-192.168.206.4@tcp:8:touch.500 00010000:00080000:0.0:1788568683.353206:0:6690:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 27f83c0c-e36b-48ce-9485-80051fd252dc@192.168.206.4@tcp t0 exp 0000000000000000 cur 317 last 0 00000020:00000080:0.0:1788568683.353240:0:6690:0:(genops.c:1385:class_connect()) connect: client 27f83c0c-e36b-48ce-9485-80051fd252dc, cookie 0x41e82f464b6a0ee4 00002000:00100000:0.0:1788568683.353252:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 27f83c0c-e36b-48ce-9485-80051fd252dc/ffff9ae277a79800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788568683.353263:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788568683.353497:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788568683.353524:0:6690:0:(import.c:65:import_set_state_nolock()) ffff9ae277a7b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788568683.353651:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fa22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2360:x1875449958385920:12345-192.168.206.4@tcp:8:touch.500 Request processed in 473us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568683.353675:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 16 00000100:00100000:3.0:1788568683.364647:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568683.366203:0:8111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958386048 00000100:00100000:2.0:1788568683.366220:0:8111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958386048 00000100:00100000:2.0:1788568683.366319:0:8111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 17 00000100:00100000:2.0:1788568683.366330:0:8111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+6:0:x1875449958386048:12345-192.168.206.4@tcp:2:touch.500 00000100:00080000:0.0:1788568683.367820:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1788568683.410834:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 27f83c0c-e36b-48ce-9485-80051fd252dc 00000001:00080000:1.0:1788568683.411045:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:0.0:1788568683.411361:0:8111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+5:0:x1875449958386048:12345-192.168.206.4@tcp:2:touch.500 Request processed in 45026us (46726us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788568683.411371:0:8111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 17 00000100:00100000:3.0:1788568683.416146:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568683.416579:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958386304 00000100:00100000:1.0:1788568683.416591:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958386304 00000100:00100000:1.0:1788568683.416655:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 2 00000100:00100000:1.0:1788568683.416665:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+10:9692:x1875449958386304:12345-192.168.206.4@tcp:35:touch.500 00000100:00100000:1.0:1788568683.417035:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+11:9692:x1875449958386304:12345-192.168.206.4@tcp:35:touch.500 Request processed in 370us (901us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788568683.417043:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 2 00000100:00100000:0.0:1788568683.430907:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568683.431041:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958386432 00000100:00100000:1.0:1788568683.431050:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958386432 00000100:00100000:1.0:1788568683.431098:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 25 00000100:00100000:1.0:1788568683.431108:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+11:9693:x1875449958386432:12345-192.168.206.4@tcp:101:rm.0 00010000:00010000:1.0:1788568683.431131:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568683.431151:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0eeb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beaa8 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.431209:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045600/0x41e82f464b6a0ef2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.431224:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045600/0x41e82f464b6a0ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.431254:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045600/0x41e82f464b6a0ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568683.431285:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788568683.431289:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788568683.431321:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045600/0x41e82f464b6a0ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.431345:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0eeb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beaa8 expref: 13 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.431363:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045600/0x41e82f464b6a0ef2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beaa8 expref: 12 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.431371:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ae255fb9d00) 00010000:00010000:1.0:1788568683.431373:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788568683.431377:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae282045600, rc 0) 00000100:00100000:1.0:1788568683.431448:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+12:9693:x1875449958386432:12345-192.168.206.4@tcp:101:rm.0 Request processed in 341us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568683.431456:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 25 00000100:00100000:3.0:1788568683.451334:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568683.451491:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958386688 00000100:00100000:1.0:1788568683.451506:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958386688 00000100:00100000:1.0:1788568683.451572:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 26 00000100:00100000:1.0:1788568683.451581:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+12:9693:x1875449958386688:12345-192.168.206.4@tcp:101:rm.0 00010000:00010000:1.0:1788568683.451600:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568683.451704:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0ef9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beaaf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568683.451811:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788568683.452005:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0ef9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beaaf expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.452019:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae24515a800) 00010000:00010000:1.0:1788568683.452022:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788568683.452027:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0ef9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beaaf expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.452042:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae282044000, rc 0) 00000100:00100000:1.0:1788568683.452100:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+13:9693:x1875449958386688:12345-192.168.206.4@tcp:101:rm.0 Request processed in 520us (784us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1788568683.452108:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 26 00000100:00100000:3.0:1788568683.462312:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568683.462995:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958386816 00000100:00100000:1.0:1788568683.463009:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958386816 00000100:00100000:1.0:1788568683.463076:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 3 00000100:00100000:1.0:1788568683.463087:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+13:9693:x1875449958386816:12345-192.168.206.4@tcp:37:rm.0 00000100:00100000:2.0:1788568683.473419:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+13:9693:x1875449958386816:12345-192.168.206.4@tcp:37:rm.0 Request processed in 10322us (11115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568683.473443:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 3 00000100:00100000:3.0:1788568683.496063:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568683.497978:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958387072 00000100:00100000:1.0:1788568683.497992:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958387072 00000100:00100000:1.0:1788568683.498064:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 4 00000100:00100000:1.0:1788568683.498074:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2492b2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+13:9693:x1875449958387072:12345-192.168.206.4@tcp:35:rm.0 00000100:00100000:1.0:1788568683.498308:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2492b2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+14:9693:x1875449958387072:12345-192.168.206.4@tcp:35:rm.0 Request processed in 234us (2260us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788568683.498315:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 4 00000100:00100000:3.0:1788568683.506145:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568683.506261:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958387328 00000100:00100000:1.0:1788568683.506297:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958387328 00000100:00100000:1.0:1788568683.506368:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 27 00000100:00100000:1.0:1788568683.506378:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+14:9693:x1875449958387328:12345-192.168.206.4@tcp:101:rm.0 00010000:00010000:1.0:1788568683.506400:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568683.506438:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0f07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beab6 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.506533:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044800/0x41e82f464b6a0f0e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.506547:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044800/0x41e82f464b6a0f0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.506559:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044800/0x41e82f464b6a0f0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568683.506569:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788568683.506721:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0f07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beab6 expref: 17 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.506981:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044800/0x41e82f464b6a0f0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beab6 expref: 16 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.506991:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ae255fb9d00) 00010000:00010000:1.0:1788568683.506993:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788568683.506996:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae282044800, rc 0) 00000100:00100000:1.0:1788568683.508530:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+16:9693:x1875449958387328:12345-192.168.206.4@tcp:101:rm.0 Request processed in 2144us (2391us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788568683.508541:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 27 00000100:00100000:0.0:1788568683.526028:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568683.526477:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958387456 00000100:00100000:3.0:1788568683.526489:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958387456 00000100:00100000:3.0:1788568683.526555:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 28 00000100:00100000:3.0:1788568683.526567:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277ac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+16:9693:x1875449958387456:12345-192.168.206.4@tcp:41:rm.0 00000004:00000024:3.0:1788568683.526639:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1788568683.526714:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277ac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+16:9693:x1875449958387456:12345-192.168.206.4@tcp:41:rm.0 Request processed in 150us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568683.526722:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 28 00000100:00100000:3.0:1788568683.531041:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568683.531136:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958387584 00000100:00100000:2.0:1788568683.531147:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958387584 00000100:00100000:2.0:1788568683.531219:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 29 00000100:00100000:2.0:1788568683.531229:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+16:9693:x1875449958387584:12345-192.168.206.4@tcp:101:rm.0 00010000:00010000:2.0:1788568683.531248:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568683.531267:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a0f1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beabd expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.531339:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a0f23 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.531353:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a0f23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.531365:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a0f23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.531379:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ba00/0x41e82f464b6a0f2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.531387:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ba00/0x41e82f464b6a0f2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.531393:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ba00/0x41e82f464b6a0f2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.531505:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a0f31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.531530:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a0f31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.531537:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a0f31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788568683.531565:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788568683.531569:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788568683.531589:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a0f31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.531600:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a0f31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.531608:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a0f23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.531613:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a0f23 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.531620:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a0f23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.531626:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7aa00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568683.531630:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a0f23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.531638:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a0f23 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.531649:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ae255fb9d00) 00010000:00010000:2.0:1788568683.531652:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788568683.531663:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a0f23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.531670:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a0f23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.531683:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ba00/0x41e82f464b6a0f2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.531689:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ba00/0x41e82f464b6a0f2a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.531695:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ba00/0x41e82f464b6a0f2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.531700:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7ba00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568683.531703:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ba00/0x41e82f464b6a0f2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.531709:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ba00/0x41e82f464b6a0f2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.531717:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x2f2003ca (ffff9ae255fb9000) 00010000:00010000:2.0:1788568683.531719:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788568683.531723:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ba00/0x41e82f464b6a0f2a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.531729:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ba00/0x41e82f464b6a0f2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.531759:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a0f1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beabd expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.531785:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a0f31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beabd expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.531792:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ae24515a500) 00010000:00010000:2.0:1788568683.531795:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788568683.531798:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7bc00, rc 0) 00000100:00100000:2.0:1788568683.531874:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+17:9693:x1875449958387584:12345-192.168.206.4@tcp:101:rm.0 Request processed in 646us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568683.531883:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 29 00000100:00100000:3.0:1788568683.536066:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568683.540616:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958387840 00000100:00100000:1.0:1788568683.542078:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958387840 00000100:00100000:0.0:1788568683.542477:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 30 00000100:00100000:0.0:1788568683.542489:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+17:9693:x1875449958387840:12345-192.168.206.4@tcp:36:rm.0 00010000:00010000:0.0:1788568683.542540:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788568683.542567:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a0f31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beabd expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.542590:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044e00/0x41e82f464b6a0edd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beaa1 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.542603:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ae24515a500) 00010000:00010000:0.0:1788568683.542617:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045600/0x41e82f464b6a0ef2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beaa8 expref: 15 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.542964:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ae255fb9d00) 00010000:00010000:0.0:1788568683.542969:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788568683.542991:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a0f38 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.543004:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a0f38 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.543028:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a0f38 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.543043:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a0f3f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.543051:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a0f3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.543057:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a0f3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.543383:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab600/0x41e82f464b6a0f46 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.543391:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab600/0x41e82f464b6a0f46 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.543398:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab600/0x41e82f464b6a0f46 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788568683.544319:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1788568683.544331:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 317952403408ns, next at 318952400759ns, rc = 0 00010000:00010000:0.0:1788568683.544387:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa000/0x41e82f464b6a0f4d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.544397:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa000/0x41e82f464b6a0f4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.544405:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa000/0x41e82f464b6a0f4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.544865:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa000/0x41e82f464b6a0f4d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.544875:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa000/0x41e82f464b6a0f4d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.544881:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa000/0x41e82f464b6a0f4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.544906:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788568683.544944:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab600/0x41e82f464b6a0f46 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.544951:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab600/0x41e82f464b6a0f46 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.544956:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab600/0x41e82f464b6a0f46 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.544962:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feab600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568683.544966:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab600/0x41e82f464b6a0f46 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.544973:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab600/0x41e82f464b6a0f46 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.544986:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ae24515a400) 00010000:00010000:0.0:1788568683.544989:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788568683.544992:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab600/0x41e82f464b6a0f46 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.545008:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab600/0x41e82f464b6a0f46 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.545028:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a0f38 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.545035:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a0f38 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.545040:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a0f38 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.545044:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaa200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568683.545047:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a0f38 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.545053:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a0f38 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.545061:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ae255fb9d00) 00010000:00010000:0.0:1788568683.545063:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788568683.545065:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a0f38 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.545070:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a0f38 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788568683.545078:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000072f460fd reply state 00000000459e9d44 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a0f3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568683.545086:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788568683.545174:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+16:9693:x1875449958387840:12345-192.168.206.4@tcp:36:rm.0 Request processed in 2683us (9113us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788568683.545182:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 30 00010000:00010000:1.0:1788568683.545263:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788568683.545270:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa000/0x41e82f464b6a0f4d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.545276:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaa000 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:1.0:1788568683.545279:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa000/0x41e82f464b6a0f4d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.545285:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa000/0x41e82f464b6a0f4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.545295:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ae24515a400) 00010000:00010000:1.0:1788568683.545297:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788568683.545300:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa000/0x41e82f464b6a0f4d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.545305:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa000/0x41e82f464b6a0f4d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568683.545319:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568683.545321:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568683.545322:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568683.549012:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a0f3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.549028:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a0f3f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.549035:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a0f3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.549041:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaa800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568683.549045:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a0f3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.549053:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a0f3f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.549069:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x2f2003ca (ffff9ae24515a200) 00010000:00010000:2.0:1788568683.549072:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788568683.549076:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a0f3f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.549098:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a0f3f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568683.550041:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568683.550696:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958388096 00000100:00100000:1.0:1788568683.550706:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958388096 00000100:00100000:1.0:1788568683.550771:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 5 00000100:00100000:1.0:1788568683.550781:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+15:9693:x1875449958388096:12345-192.168.206.4@tcp:35:rm.0 00000100:00100000:1.0:1788568683.551036:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+16:9693:x1875449958388096:12345-192.168.206.4@tcp:35:rm.0 Request processed in 255us (999us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788568683.551043:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 5 00000100:00100000:0.0:1788568683.554203:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568683.554490:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958388352 00000100:00100000:2.0:1788568683.554500:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958388352 00000100:00100000:2.0:1788568683.554557:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 31 00000100:00100000:2.0:1788568683.554567:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+16:9693:x1875449958388352:12345-192.168.206.4@tcp:36:rm.0 00010000:00010000:2.0:1788568683.554617:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788568683.554641:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044800/0x41e82f464b6a0f0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beab6 expref: 16 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.554662:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b800/0x41e82f464b6a0eac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea93 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.554671:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ae255fb9d00) 00010000:00010000:2.0:1788568683.554686:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a0e6d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea85 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.554694:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae24515a800) 00010000:00010000:2.0:1788568683.554701:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788568683.554723:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a0f54 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.554745:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a0f54 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.554755:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a0f54 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.554785:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ba00/0x41e82f464b6a0f5b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.554793:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ba00/0x41e82f464b6a0f5b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.554800:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ba00/0x41e82f464b6a0f5b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.555066:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a0f62 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.555075:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a0f62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.555082:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a0f62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788568683.555659:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788568683.555674:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a0f62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.555682:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a0f62 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.555689:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a0f62 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.555694:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7aa00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568683.555698:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a0f62 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.555715:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a0f62 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.555725:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ae255fb9900) 00010000:00010000:2.0:1788568683.555727:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788568683.555731:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a0f62 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.555737:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a0f62 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.555756:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a0f54 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.555762:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a0f54 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.555768:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a0f54 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.555773:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7a200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568683.555776:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a0f54 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.555782:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a0f54 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.555790:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae255fb9000) 00010000:00010000:2.0:1788568683.555792:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788568683.555796:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a0f54 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568683.555811:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a0f54 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788568683.555823:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009429bacd reply state 00000000284da7a4 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ba00/0x41e82f464b6a0f5b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568683.555831:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788568683.555906:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+15:9693:x1875449958388352:12345-192.168.206.4@tcp:36:rm.0 Request processed in 1339us (1711us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788568683.555914:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 31 00010000:00010000:0.0:1788568683.559807:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ba00/0x41e82f464b6a0f5b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.559824:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ba00/0x41e82f464b6a0f5b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.559832:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ba00/0x41e82f464b6a0f5b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.559838:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7ba00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568683.559843:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ba00/0x41e82f464b6a0f5b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.559851:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ba00/0x41e82f464b6a0f5b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.559867:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ae255fb9600) 00010000:00010000:0.0:1788568683.559871:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788568683.559876:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ba00/0x41e82f464b6a0f5b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.559882:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ba00/0x41e82f464b6a0f5b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568683.706824:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568684.727317:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568685.074283:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568685.074316:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568685.074386:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568685.074411:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568685.074451:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958388736 00000100:00100000:2.0:1788568685.074461:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958388736 00000100:00100000:2.0:1788568685.074514:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 58 00000100:00100000:2.0:1788568685.074525:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b565180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2361:x1875449958388736:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:2.0:1788568685.074595:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b565180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2361:x1875449958388736:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 71us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568685.074601:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 58 00000100:00100000:2.0:1788568685.074700:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958388608 00000100:00100000:2.0:1788568685.074706:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958388608 00000100:00100000:2.0:1788568685.074732:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958388864 00000100:00100000:2.0:1788568685.074735:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958388864 00000100:00100000:2.0:1788568685.074758:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 102 00000100:00100000:2.0:1788568685.074765:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b564380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+14:2361:x1875449958388608:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:2.0:1788568685.074811:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b564380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+14:2361:x1875449958388608:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 46us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568685.074818:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 102 00000100:00100000:2.0:1788568685.074910:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 103 00000100:00100000:2.0:1788568685.074918:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b564e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2361:x1875449958388864:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:2.0:1788568685.074962:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b564e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2361:x1875449958388864:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 44us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568685.075096:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 103 00000100:00080000:2.0:1788568685.075117:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788568685.075121:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788568685.076636:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958388480 00000100:00100000:1.0:1788568685.076650:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958388480 00000100:00100000:1.0:1788568685.076705:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 248 00000100:00100000:1.0:1788568685.076715:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+13:2361:x1875449958388480:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:1.0:1788568685.076781:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+13:2361:x1875449958388480:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 66us (2504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568685.076787:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 248 00010000:00010000:3.0:1788568685.751199:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568686.775728:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568687.095695:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976248064:0@lo:400:kworker.0 00000100:00100000:0.0:1788568687.095762:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568687.095840:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788568687.095847:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:925db6b8-84bc-418c-b37a-40345c1020be:3308:1875449976247680:0@lo:400:kworker.0 00000100:00100000:0.0:1788568687.095888:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568687.095951:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875449976248192:0@lo:400:kworker.0 00000100:00100000:0.0:1788568687.095989:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568687.096021:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976247680 00000100:00100000:0.0:1788568687.096029:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976247680 00000100:00100000:0.0:1788568687.096073:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788568687.096081:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+19:3308:x1875449976247680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568687.096145:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+19:3308:x1875449976247680:12345-0@lo:400:kworker.0 Request processed in 52us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568687.096153:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788568687.096213:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:925db6b8-84bc-418c-b37a-40345c1020be:3308:1875449976247680:0@lo:400:kworker.0 00000100:00100000:2.0:1788568687.099647:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875449976247936:0@lo:400:kworker.0 00000100:00100000:2.0:1788568687.099725:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568687.099782:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788568687.099789:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875449976247808:0@lo:400:kworker.0 00000100:00100000:2.0:1788568687.099829:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568687.099848:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976248320:0@lo:400:kworker.0 00000100:00100000:2.0:1788568687.099885:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568687.099954:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976248192 00000100:00100000:2.0:1788568687.099972:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976248192 00000100:00100000:2.0:1788568687.100019:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976247936 00000100:00100000:2.0:1788568687.100023:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976247936 00000100:00100000:2.0:1788568687.100036:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976247808 00000100:00100000:2.0:1788568687.100038:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976247808 00000100:00100000:2.0:1788568687.100052:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788568687.100059:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875449976248192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568687.100108:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875449976248192:12345-0@lo:400:kworker.0 Request processed in 49us (4118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568687.100122:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788568687.100150:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788568687.100157:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b567b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875449976247936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568687.100192:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b567b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875449976247936:12345-0@lo:400:kworker.0 Request processed in 36us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568687.100197:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788568687.100208:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788568687.100214:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875449976247808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568687.100239:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875449976247808:12345-0@lo:400:kworker.0 Request processed in 26us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568687.100244:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:2.0:1788568687.100260:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788568687.100287:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875449976247808:0@lo:400:kworker.0 00000100:00100000:2.0:1788568687.100297:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875449976247936:0@lo:400:kworker.0 00000100:00100000:3.0:1788568687.100395:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976248064 00000100:00100000:3.0:1788568687.100399:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976248064 00000100:00100000:3.0:1788568687.100450:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976248320 00000100:00100000:3.0:1788568687.100454:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976248320 00000100:00100000:3.0:1788568687.100473:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788568687.100482:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976248064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568687.100519:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976248064:12345-0@lo:400:kworker.0 Request processed in 39us (4757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568687.100525:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788568687.100538:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788568687.100544:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976248320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568687.100576:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976248320:12345-0@lo:400:kworker.0 Request processed in 32us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568687.100581:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:3.0:1788568687.100608:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae141c31180 x1875449976248320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568687.100618:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976248320:0@lo:400:kworker.0 00000100:00080000:2.0:1788568687.101108:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788568687.101112:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788568687.101349:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875449976248192:0@lo:400:kworker.0 00010000:00080000:0.0:1788568687.101363:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae141c30e00 x1875449976248064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568687.101372:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976248064:0@lo:400:kworker.0 00000100:00100000:2.0:1788568687.607093:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788568687.607117:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976248448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788568687.607185:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568687.607452:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976248448 00000100:00100000:1.0:1788568687.607460:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976248448 00000100:00100000:1.0:1788568687.607512:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788568687.607521:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976248448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788568687.607553:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788568687.607594:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976248448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568687.607709:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1788568687.608181:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae244b2c000 x1875449976248448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568703 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568687.608198:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976248448:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788568687.803647:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788568688.117900:0:11617:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000004:00080000:1.0:1788568688.132988:0:7137:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 322541057564ns, next at 323541054925ns, rc = 0 00000100:00100000:0.0:1788568688.133093:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26fa23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976248576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788568688.133414:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568688.133622:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976248576 00000100:00100000:1.0:1788568688.133630:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976248576 00000100:00100000:1.0:1788568688.133680:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788568688.133690:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976248576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788568688.133720:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788568688.133776:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976248576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568688.133786:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1788568688.133879:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae26fa23b80 x1875449976248576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568704 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568688.133909:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26fa23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976248576:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1788568688.707204:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:0.0:1788568688.707223:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000004:00080000:0.0:1788568688.707258:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1788568688.707263:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000001:00080000:0.0:1788568688.707371:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:3.0:1788568688.707532:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788568688.707559:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976248704:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788568688.707662:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568688.707746:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976248704 00000100:00100000:3.0:1788568688.707755:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976248704 00000100:00100000:3.0:1788568688.707829:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788568688.707841:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976248704:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788568688.707900:0:6688:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1788568688.707975:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9b646a, atime: 0x6a9b646a, ctime: 0x6a9b646a, blocks: 0x1 00010000:00010000:3.0:1788568688.707985:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f69bb1dc/0x41e82f464b6a0f69 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568688.708005:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=323s v=(0 0) 00010000:00010000:3.0:1788568688.708010:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788568688.708018:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f69bb1dc/0x41e82f464b6a0f69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568688.708038:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f69bb1dc/0x41e82f464b6a0f69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568688.708049:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f69bb1dc/0x41e82f464b6a0f69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568688.708058:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f69bb1dc/0x41e82f464b6a0f69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568688.708087:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788568688.708790:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1875449976248704:12345-0@lo:6:osp-syn-0-0.0 Request processed in 945us (1121us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788568688.708802:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1788568688.708851:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788568688.708860:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f69bb1dc/0x41e82f464b6a0f69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568688.708871:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429df600 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788568688.708878:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f69bb1dc/0x41e82f464b6a0f69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568688.708889:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f69bb1dc/0x41e82f464b6a0f69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568688.708909:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f69bb1dc/0x41e82f464b6a0f69 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568688.708916:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f69bb1dc/0x41e82f464b6a0f69 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568688.708968:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568688.708971:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568688.708973:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788568688.709019:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ae141c31180/2, rc 0, transno 4294967300 00000100:00100000:3.0:1788568688.709027:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976248704:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788568688.824099:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788568689.391236:0:11667:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd577e2400 20000000:00000080:0.0:1788568689.391262:0:11667:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ae277957400 uarg=0000000000000000 20000000:01000000:0.0:1788568689.391309:0:11667:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788568689.391319:0:11667:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788568689.391325:0:11667:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1788568689.394366:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1788568689.394716:0:11667:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1788568689.401751:0:11667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1788568689.401826:0:11667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1788568689.401912:0:11667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1788568689.402231:0:11667:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788568689.404312:0:11667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ae252e7ba00/0x41e82f464b6a0f70 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568689.404373:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0e0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea70 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568689.404382:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae27feaa400/0x41e82f464b6a0e12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea77 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568689.404392:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae27feabc00/0x41e82f464b6a0e20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0e19 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568689.404409:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae252e7a800/0x41e82f464b6a0e2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0e27 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568689.404417:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae252e7a400/0x41e82f464b6a0e3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0e35 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568689.404426:0:11667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ae252e7ba00/0x41e82f464b6a0f70 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568689.404491:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae252e7a400/0x41e82f464b6a0e3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x41e82f464b6a0e35 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568689.404512:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae252e7a400/0x41e82f464b6a0e3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x41e82f464b6a0e35 expref: 18 pid: 5834 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568689.404534:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244b2c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875449976248832:0@lo:104: 00000100:00100000:2.0:1788568689.404707:0:11667:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788568689.404808:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae252e7a800/0x41e82f464b6a0e2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x41e82f464b6a0e27 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568689.404817:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae252e7a800/0x41e82f464b6a0e2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x41e82f464b6a0e27 expref: 18 pid: 5836 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568689.404833:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244b2c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875449976248960:0@lo:104: 00000100:00100000:2.0:1788568689.404857:0:11667:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788568689.404894:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae27feabc00/0x41e82f464b6a0e20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x41e82f464b6a0e19 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568689.404902:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae27feabc00/0x41e82f464b6a0e20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x41e82f464b6a0e19 expref: 18 pid: 5836 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568689.404910:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244b2f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875449976249088:0@lo:104: 00000100:00100000:2.0:1788568689.404973:0:11667:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788568689.404998:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae27feaa400/0x41e82f464b6a0e12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea77 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568689.405007:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae27feaa400/0x41e82f464b6a0e12 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea77 expref: 12 pid: 5836 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568689.405016:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244b2e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875449976249216:192.168.206.4@tcp:104: 00000100:00100000:3.0:1788568689.405252:0:6704:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788568689.405271:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976248832 00000100:00100000:3.0:1788568689.405279:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976248832 00000100:00100000:3.0:1788568689.405337:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976248960 00000100:00100000:3.0:1788568689.405341:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976248960 00000100:00100000:3.0:1788568689.405353:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976249088 00000100:00100000:3.0:1788568689.405355:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976249088 00000100:00100000:3.0:1788568689.405370:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788568689.405379:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:925db6b8-84bc-418c-b37a-40345c1020be+5:11667:x1875449976248832:12345-0@lo:104: 00010000:00010000:3.0:1788568689.405405:0:6704:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.104@tcp lock: ffff9ae252e7ae00/0x41e82f464b6a0e35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0e3c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568689.405467:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788568689.405473:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:925db6b8-84bc-418c-b37a-40345c1020be+5:11667:x1875449976248832:12345-0@lo:104: Request processed in 96us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568689.405479:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788568689.405504:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788568689.405510:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:925db6b8-84bc-418c-b37a-40345c1020be+4:11667:x1875449976248960:12345-0@lo:104: 00010000:00010000:3.0:1788568689.405518:0:6704:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.104@tcp lock: ffff9ae252e7be00/0x41e82f464b6a0e27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0e2e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568689.405554:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788568689.405558:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:925db6b8-84bc-418c-b37a-40345c1020be+4:11667:x1875449976248960:12345-0@lo:104: Request processed in 50us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568689.405563:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788568689.405574:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788568689.405581:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27feac050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:925db6b8-84bc-418c-b37a-40345c1020be+3:11667:x1875449976249088:12345-0@lo:104: 00010000:00010000:3.0:1788568689.405608:0:6704:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.104@tcp lock: ffff9ae27feab000/0x41e82f464b6a0e19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0e20 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568689.405648:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788568689.405653:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27feac050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:925db6b8-84bc-418c-b37a-40345c1020be+3:11667:x1875449976249088:12345-0@lo:104: Request processed in 74us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568689.405659:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1788568689.405706:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788568689.405714:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae252e7ae00/0x41e82f464b6a0e35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0e3c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568689.405722:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7ae00 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:3.0:1788568689.405727:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae252e7ae00/0x41e82f464b6a0e35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x41e82f464b6a0e3c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568689.405736:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae252e7ae00/0x41e82f464b6a0e35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x41e82f464b6a0e3c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788568689.405743:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae252e7ae00/0x41e82f464b6a0e35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x41e82f464b6a0e3c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788568689.405748:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788568689.405785:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae252e7ae00/0x41e82f464b6a0e35 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0e3c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568689.405792:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788568689.405818:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae252e7ae00/0x41e82f464b6a0e35 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0e3c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568689.405826:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae252e7ae00/0x41e82f464b6a0e35 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0e3c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568689.405852:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788568689.405856:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae252e7be00/0x41e82f464b6a0e27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0e2e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568689.405862:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7be00 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:3.0:1788568689.405865:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae252e7be00/0x41e82f464b6a0e27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x41e82f464b6a0e2e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568689.405873:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae252e7be00/0x41e82f464b6a0e27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x41e82f464b6a0e2e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788568689.405879:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae252e7be00/0x41e82f464b6a0e27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x41e82f464b6a0e2e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788568689.405885:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788568689.405900:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae252e7be00/0x41e82f464b6a0e27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0e2e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568689.405905:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788568689.405912:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae252e7be00/0x41e82f464b6a0e27 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0e2e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568689.405919:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae252e7be00/0x41e82f464b6a0e27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0e2e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568689.405949:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788568689.405952:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae27feab000/0x41e82f464b6a0e19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a0e20 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568689.405967:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feab000 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:3.0:1788568689.405970:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae27feab000/0x41e82f464b6a0e19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x41e82f464b6a0e20 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568689.405976:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae27feab000/0x41e82f464b6a0e19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x41e82f464b6a0e20 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788568689.405982:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae27feab000/0x41e82f464b6a0e19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x41e82f464b6a0e20 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788568689.405987:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788568689.406000:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae27feab000/0x41e82f464b6a0e19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0e20 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568689.406006:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788568689.406024:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae27feab000/0x41e82f464b6a0e19 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0e20 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568689.406030:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae27feab000/0x41e82f464b6a0e19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a0e20 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568689.406045:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568689.406047:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568689.406048:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568689.406055:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568689.406071:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976249344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788568689.406112:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568689.406157:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788568689.406163:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976249472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788568689.406193:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568689.406220:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:925db6b8-84bc-418c-b37a-40345c1020be:3308:1875449976249600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788568689.406247:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568689.406282:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976249344 00000100:00100000:3.0:1788568689.406288:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976249344 00010000:00010000:3.0:1788568689.406314:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae252e7a400/0x41e82f464b6a0e3c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0e35 expref: 19 pid: 5834 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568689.408132:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568689.409381:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0e0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea70 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568689.409861:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0e0b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea70 expref: 12 pid: 5834 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568689.409881:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244b2f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875449976249728:192.168.206.4@tcp:104: 00000100:00100000:2.0:1788568689.410332:0:11667:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2779470c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788568689.410378:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244b2c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875449976248832:0@lo:104: 00000100:00100000:2.0:1788568689.410392:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244b2c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875449976248960:0@lo:104: 00000100:00100000:2.0:1788568689.410440:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244b2f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875449976249088:0@lo:104: 00000100:00100000:2.0:1788568689.411270:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976249472 00000100:00100000:2.0:1788568689.411294:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976249472 00010000:00010000:2.0:1788568689.411356:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae252e7a800/0x41e82f464b6a0e2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0e27 expref: 20 pid: 5836 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568689.411389:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976249600 00000100:00100000:2.0:1788568689.411404:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976249600 00010000:00010000:2.0:1788568689.411426:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae27feabc00/0x41e82f464b6a0e20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0e19 expref: 21 pid: 5836 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568689.411514:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788568689.416034:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568689.417060:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958388992 00000100:00100000:1.0:1788568689.417078:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958388992 00010000:00010000:1.0:1788568689.417147:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae27feaa400/0x41e82f464b6a0e12 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea77 expref: 13 pid: 5836 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568689.417802:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788568689.417821:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:925db6b8-84bc-418c-b37a-40345c1020be+21:3306:x1875449976249472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788568689.417843:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568689.417853:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae252e7a800/0x41e82f464b6a0e2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0e27 expref: 21 pid: 5836 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568689.417868:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae252e7a800/0x41e82f464b6a0e2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x41e82f464b6a0e27 expref: 21 pid: 5836 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568689.417892:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae252e7a800/0x41e82f464b6a0e2e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x41e82f464b6a0e27 expref: 21 pid: 5836 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568689.417915:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568689.418018:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:925db6b8-84bc-418c-b37a-40345c1020be+20:3306:x1875449976249472:12345-0@lo:103:ldlm_bl.0 Request processed in 205us (11823us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568689.418027:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788568689.418053:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788568689.418060:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25319d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:925db6b8-84bc-418c-b37a-40345c1020be+19:3308:x1875449976249600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788568689.418089:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568689.418095:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae27feabc00/0x41e82f464b6a0e20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0e19 expref: 19 pid: 5836 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568689.418103:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae27feabc00/0x41e82f464b6a0e20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x41e82f464b6a0e19 expref: 19 pid: 5836 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568689.418114:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae27feabc00/0x41e82f464b6a0e20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x41e82f464b6a0e19 expref: 19 pid: 5836 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568689.418377:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976249472:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788568689.418571:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568689.418701:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25319d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:925db6b8-84bc-418c-b37a-40345c1020be+18:3308:x1875449976249600:12345-0@lo:103:ldlm_bl.0 Request processed in 641us (12452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568689.418709:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788568689.418783:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:925db6b8-84bc-418c-b37a-40345c1020be:3308:1875449976249600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788568689.419006:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244b2e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875449976249216:192.168.206.4@tcp:104: 00000100:00100000:2.0:1788568689.419081:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:925db6b8-84bc-418c-b37a-40345c1020be+17:3306:x1875449976249344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788568689.419098:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568689.419105:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae252e7a400/0x41e82f464b6a0e3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a0e35 expref: 17 pid: 5834 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568689.419119:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae252e7a400/0x41e82f464b6a0e3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x41e82f464b6a0e35 expref: 17 pid: 5834 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568689.419278:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae252e7a400/0x41e82f464b6a0e3c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x41e82f464b6a0e35 expref: 17 pid: 5834 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568689.419290:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568689.419423:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:925db6b8-84bc-418c-b37a-40345c1020be+16:3306:x1875449976249344:12345-0@lo:103:ldlm_bl.0 Request processed in 7894us (13309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568689.419431:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788568689.419724:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976249344:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788568689.422180:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568689.422709:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958389120 00000100:00100000:2.0:1788568689.422722:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958389120 00010000:00010000:2.0:1788568689.422773:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0e0b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea70 expref: 14 pid: 5834 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568689.422860:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 33 00000100:00100000:2.0:1788568689.422873:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f0f084e-5158-464d-a770-11379825208e+14:2364:x1875449958389120:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788568689.422892:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568689.422899:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0e0b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea70 expref: 14 pid: 5834 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568689.422912:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0e0b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea70 expref: 14 pid: 5834 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568689.422957:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568689.423030:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f0f084e-5158-464d-a770-11379825208e+14:2364:x1875449958389120:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 159us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568689.423038:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 33 00000100:00100000:3.0:1788568689.423254:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 34 00000100:00100000:3.0:1788568689.423285:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3f0f084e-5158-464d-a770-11379825208e+13:2363:x1875449958388992:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788568689.423305:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568689.423315:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae27feaa400/0x41e82f464b6a0e12 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea77 expref: 13 pid: 5836 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568689.423331:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae27feaa400/0x41e82f464b6a0e12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea77 expref: 13 pid: 5836 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568689.423351:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae27feaa400/0x41e82f464b6a0e12 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea77 expref: 13 pid: 5836 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568689.423368:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ae252e7ba00/0x41e82f464b6a0f70 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568689.423377:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae252e7ba00/0x41e82f464b6a0f70 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568689.423406:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae252e7ba00/0x41e82f464b6a0f70 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568689.423433:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae252e7ba00/0x41e82f464b6a0f70 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568689.423440:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ae252e7ba00/0x41e82f464b6a0f70 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568689.423447:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ae252e7ba00/0x41e82f464b6a0f70 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568689.423453:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7ba00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788568689.423458:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ae252e7ba00/0x41e82f464b6a0f70 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568689.423466:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ae252e7ba00/0x41e82f464b6a0f70 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568689.423476:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ae252e7ba00/0x41e82f464b6a0f70 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568689.423487:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788568689.423540:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3f0f084e-5158-464d-a770-11379825208e+12:2363:x1875449958388992:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 271us (7521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568689.423548:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 34 00010000:00010000:2.0:1788568689.427706:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a0e0b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea70 expref: 11 pid: 5834 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568689.427735:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244b2f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875449976249728:192.168.206.4@tcp:104: 00010000:00010000:2.0:1788568689.427792:0:11667:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ae252e7ba00/0x41e82f464b6a0f70 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568689.427805:0:11667:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ae252e7ba00/0x41e82f464b6a0f70 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568689.427813:0:11667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ae252e7ba00/0x41e82f464b6a0f70 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568689.427846:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae252e7ba00/0x41e82f464b6a0f70 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568689.847266:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568690.192914:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568690.193017:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568690.193048:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568690.193086:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568690.193105:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958389504 00000100:00100000:2.0:1788568690.193135:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958389504 00000100:00100000:0.0:1788568690.193141:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958389376 00000100:00100000:0.0:1788568690.193152:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958389376 00000100:00100000:0.0:1788568690.193425:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958389632 00000100:00100000:0.0:1788568690.193431:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958389632 00000100:00100000:0.0:1788568690.193467:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 107 00000100:00100000:0.0:1788568690.193479:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2364:x1875449958389376:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:0.0:1788568690.193575:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2364:x1875449958389376:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 98us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568690.193720:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 107 00000100:00100000:0.0:1788568690.193761:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 108 00000100:00100000:0.0:1788568690.193768:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae14350e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2364:x1875449958389632:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:0.0:1788568690.193799:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae14350e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2364:x1875449958389632:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 31us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568690.193806:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 108 00000100:00080000:0.0:1788568690.194026:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788568690.194033:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788568690.194134:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958389248 00000100:00100000:1.0:1788568690.194140:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958389248 00000100:00100000:1.0:1788568690.194189:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 250 00000100:00100000:1.0:1788568690.194198:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae266991850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+11:2364:x1875449958389248:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:1.0:1788568690.194246:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae266991850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+11:2364:x1875449958389248:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 49us (1349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568690.194253:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 250 00000100:00100000:2.0:1788568690.196217:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 61 00000100:00100000:2.0:1788568690.196249:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2364:x1875449958389504:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:2.0:1788568690.196341:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2364:x1875449958389504:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 110us (3323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568690.196348:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 61 00000100:00100000:0.0:1788568690.515973:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568690.516132:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958389760 00000100:00100000:1.0:1788568690.516148:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958389760 00000100:00100000:1.0:1788568690.516222:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 251 00000100:00100000:1.0:1788568690.516235:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae266992450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+11:5603:x1875449958389760:12345-192.168.206.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788568690.516260:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568690.516287:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae282044e00/0x41e82f464b6a0f77 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beac4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568690.516324:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae282044e00/0x41e82f464b6a0f77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beac4 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568690.516337:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae282044e00/0x41e82f464b6a0f77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beac4 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568690.516382:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae282044e00, rc 0) 00000100:00100000:1.0:1788568690.516482:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae266992450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+12:5603:x1875449958389760:12345-192.168.206.4@tcp:101:ll_cfg_requeue.0 Request processed in 249us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568690.516490:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 251 00000100:00100000:3.0:1788568690.519365:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568690.519475:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958389888 00000100:00100000:0.0:1788568690.519489:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958389888 00000100:00100000:0.0:1788568690.519554:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 252 00000100:00100000:0.0:1788568690.519565:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae252782850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+12:5603:x1875449958389888:12345-192.168.206.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788568690.520284:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae252782850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+12:5603:x1875449958389888:12345-192.168.206.4@tcp:501:ll_cfg_requeue.0 Request processed in 714us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568690.520295:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 252 00000100:00100000:2.0:1788568690.523276:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568690.527334:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958390016 00000100:00100000:0.0:1788568690.527361:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958390016 00000100:00100000:0.0:1788568690.527476:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 253 00000100:00100000:0.0:1788568690.527490:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae252783850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+12:5603:x1875449958390016:12345-192.168.206.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788568690.528097:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae252783850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+12:5603:x1875449958390016:12345-192.168.206.4@tcp:503:ll_cfg_requeue.0 Request processed in 607us (4834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568690.528107:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 253 00000100:00100000:2.0:1788568690.542481:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568690.543061:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958390144 00000100:00100000:1.0:1788568690.543077:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958390144 00000100:00100000:1.0:1788568690.543193:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 254 00000100:00100000:1.0:1788568690.543205:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae252780c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+12:9963:x1875449958390144:12345-192.168.206.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788568690.543551:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae252780c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+12:9963:x1875449958390144:12345-192.168.206.4@tcp:502:llog_process_th.0 Request processed in 347us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568690.543560:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 254 00000100:00100000:3.0:1788568690.548025:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568690.575020:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958390272 00000100:00100000:0.0:1788568690.575042:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958390272 00000100:00100000:0.0:1788568690.575145:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 255 00000100:00100000:0.0:1788568690.575158:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae252780850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+12:9963:x1875449958390272:12345-192.168.206.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788568690.575552:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae252780850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+12:9963:x1875449958390272:12345-192.168.206.4@tcp:502:llog_process_th.0 Request processed in 395us (27540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568690.575561:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 255 00000100:00100000:3.0:1788568690.580064:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568690.580899:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958390400 00000100:00100000:0.0:1788568690.580916:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958390400 00000100:00100000:0.0:1788568690.580997:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 256 00000100:00100000:0.0:1788568690.581009:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+12:5603:x1875449958390400:12345-192.168.206.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788568690.581030:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568690.581053:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae27feaa000/0x41e82f464b6a0f7e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beacb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568690.581086:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae27feaa000/0x41e82f464b6a0f7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beacb expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568690.581099:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae27feaa000/0x41e82f464b6a0f7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beacb expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568690.581109:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae27feaa000, rc 0) 00000100:00100000:0.0:1788568690.581203:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+13:5603:x1875449958390400:12345-192.168.206.4@tcp:101:ll_cfg_requeue.0 Request processed in 195us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568690.581211:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 256 00000100:00100000:3.0:1788568690.598689:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568690.598849:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958390528 00000100:00100000:2.0:1788568690.598864:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958390528 00000100:00100000:2.0:1788568690.598973:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 257 00000100:00100000:2.0:1788568690.598985:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+13:5603:x1875449958390528:12345-192.168.206.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788568690.599725:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+13:5603:x1875449958390528:12345-192.168.206.4@tcp:501:ll_cfg_requeue.0 Request processed in 732us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568690.599737:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 257 00000100:00100000:3.0:1788568690.602110:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568690.602282:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958390656 00000100:00100000:1.0:1788568690.602296:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958390656 00000100:00100000:1.0:1788568690.602375:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 258 00000100:00100000:1.0:1788568690.602396:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+13:5603:x1875449958390656:12345-192.168.206.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788568690.602691:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+13:5603:x1875449958390656:12345-192.168.206.4@tcp:503:ll_cfg_requeue.0 Request processed in 305us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568690.602700:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 258 00000100:00100000:3.0:1788568690.609819:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568690.610254:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958390784 00000100:00100000:2.0:1788568690.610270:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958390784 00000100:00100000:2.0:1788568690.610359:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 259 00000100:00100000:2.0:1788568690.610373:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+13:9966:x1875449958390784:12345-192.168.206.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788568690.610737:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+13:9966:x1875449958390784:12345-192.168.206.4@tcp:502:llog_process_th.0 Request processed in 366us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568690.610753:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 259 00000100:00100000:3.0:1788568690.619063:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568690.630592:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958390912 00000100:00100000:1.0:1788568690.630615:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958390912 00000100:00100000:1.0:1788568690.630732:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 260 00000100:00100000:1.0:1788568690.630744:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+13:9966:x1875449958390912:12345-192.168.206.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788568690.631116:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+13:9966:x1875449958390912:12345-192.168.206.4@tcp:502:llog_process_th.0 Request processed in 373us (12068us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568690.631137:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 260 00010000:00010000:3.0:1788568690.871174:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788568691.383089:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788568691.383100:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae277b92800 from 7 10000000:01000000:1.0:1788568691.383106:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788568691.383171:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae282045600/0x41e82f464b6a0f85 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568691.383186:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae282045600/0x41e82f464b6a0f85 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568691.383209:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae282045600/0x41e82f464b6a0f85 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568691.383246:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26fa20700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976249856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788568691.383342:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568691.383497:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae252e93480 going to sleep for 11 seconds 00000100:00100000:2.0:1788568691.383590:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976249856 00000100:00100000:2.0:1788568691.383600:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976249856 00000100:00100000:2.0:1788568691.383667:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788568691.383679:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+16:5838:x1875449976249856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788568691.383696:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568691.383713:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae252e7b800/0x41e82f464b6a0f8c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0f85 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568691.383745:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae252e7b800/0x41e82f464b6a0f8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0f85 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568691.383757:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae252e7b800/0x41e82f464b6a0f8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0f85 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568691.383769:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7b800, rc 0) 00000100:00100000:2.0:1788568691.383844:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+17:5838:x1875449976249856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568691.383851:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788568691.384043:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26fa20700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976249856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788568691.386912:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae282045600/0x41e82f464b6a0f85 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0f8c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568691.386944:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae282045600/0x41e82f464b6a0f85 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0f8c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568691.387070:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c32a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976249984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788568691.387156:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568691.387272:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976249984 00000100:00100000:1.0:1788568691.387282:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976249984 00000100:00100000:1.0:1788568691.387337:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788568691.387347:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+17:5838:x1875449976249984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788568691.387684:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+17:5838:x1875449976249984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 338us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568691.387693:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788568691.392129:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2487eba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788568691.392197:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c32a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976249984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788568691.392290:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c32a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976250112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788568691.392417:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568691.392461:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2487eba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788568691.392540:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976250112 00000100:00100000:1.0:1788568691.392548:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976250112 00000100:00100000:1.0:1788568691.392673:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788568691.392685:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+17:5838:x1875449976250112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788568691.392972:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+17:5838:x1875449976250112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 288us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568691.392988:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788568691.393078:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c32a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976250112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788568691.393682:0:11681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c32a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:11681:1875449976250240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788568691.393732:0:11681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568691.397008:0:11681:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2487eba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788568691.398987:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976250240 00000100:00100000:2.0:1788568691.399006:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976250240 00000100:00100000:2.0:1788568691.399087:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788568691.399100:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+17:11681:x1875449976250240:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788568691.403164:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+17:11681:x1875449976250240:12345-0@lo:502:llog_process_th.0 Request processed in 4054us (9418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568691.403183:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788568691.404429:0:11681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c32a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:11681:1875449976250240:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788568691.404497:0:11681:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788568691.404513:0:11681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788568691.404516:0:11681:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788568691.404524:0:11681:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ae277b92800 00000020:00000080:0.0:1788568691.404527:0:11681:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788568691.404898:0:11681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae14350d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:11681:1875449976250368:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788568691.405023:0:11681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568691.405069:0:11681:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27fd4d300 going to sleep for 11 seconds 00000100:00100000:2.0:1788568691.405690:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976250368 00000100:00100000:2.0:1788568691.405712:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976250368 00000100:00100000:2.0:1788568691.405779:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788568691.405789:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+17:11681:x1875449976250368:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788568691.406120:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+17:11681:x1875449976250368:12345-0@lo:502:llog_process_th.0 Request processed in 331us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568691.406129:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788568691.406563:0:11681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae14350d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:11681:1875449976250368:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788568691.406653:0:11681:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788568691.406663:0:11681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788568691.406665:0:11681:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788568691.406671:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788568691.406964:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788568691.406984:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788568691.406997:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae282045600/0x41e82f464b6a0f85 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0f8c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568691.407011:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae282045600/0x41e82f464b6a0f85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0f8c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788568691.407023:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788568691.407026:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae27bf74800 from 7 10000000:01000000:2.0:1788568691.407030:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788568691.407069:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a800/0x41e82f464b6a0f93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568691.407078:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a800/0x41e82f464b6a0f93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568691.407089:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a800/0x41e82f464b6a0f93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568691.407112:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244b2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976250496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788568691.407164:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568691.407248:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243d4e000 going to sleep for 11 seconds 00000100:00100000:3.0:1788568691.412212:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976250496 00000100:00100000:3.0:1788568691.412232:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976250496 00000100:00100000:3.0:1788568691.412357:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788568691.412371:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+17:5838:x1875449976250496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788568691.412405:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568691.412450:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae2429df600/0x41e82f464b6a0f9a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0f93 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568691.412490:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae2429df600/0x41e82f464b6a0f9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0f93 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568691.412504:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae2429df600/0x41e82f464b6a0f9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0f93 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568691.412515:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429df600, rc 0) 00000100:00100000:3.0:1788568691.412630:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+18:5838:x1875449976250496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 263us (5466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568691.412637:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788568691.413554:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244b2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976250496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788568691.413582:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a800/0x41e82f464b6a0f93 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0f9a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568691.413594:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a800/0x41e82f464b6a0f93 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0f9a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568691.413693:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c32a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976250624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788568691.413751:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568691.421506:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976250624 00000100:00100000:2.0:1788568691.421541:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976250624 00000100:00100000:2.0:1788568691.421625:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788568691.421638:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+18:5838:x1875449976250624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788568691.422061:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+18:5838:x1875449976250624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 424us (8309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568691.422070:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788568691.422163:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae277d98e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788568691.422194:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c32a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976250624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788568691.422261:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244b2e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976250752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788568691.422312:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568691.422337:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae277947000 going to sleep for 11 seconds 00000100:00100000:2.0:1788568691.422349:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976250752 00000100:00100000:2.0:1788568691.422354:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976250752 00000100:00100000:2.0:1788568691.422372:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788568691.422379:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+18:5838:x1875449976250752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788568691.422551:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+18:5838:x1875449976250752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 172us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568691.422557:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788568691.422602:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244b2e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976250752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788568691.422833:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244b2e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:11683:1875449976250880:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788568691.422871:0:11683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568691.422894:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976250880 00000100:00100000:2.0:1788568691.422897:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976250880 00000100:00100000:2.0:1788568691.422916:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788568691.422922:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+18:11683:x1875449976250880:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788568691.423100:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+18:11683:x1875449976250880:12345-0@lo:502:llog_process_th.0 Request processed in 177us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568691.423108:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788568691.423141:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae26fb73c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788568691.423154:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244b2e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:11683:1875449976250880:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788568691.423182:0:11683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788568691.423194:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788568691.423196:0:11683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788568691.423205:0:11683:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ae27bf74800 00000020:00000080:2.0:1788568691.423207:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788568691.423285:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244b2e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:11683:1875449976251008:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788568691.423320:0:11683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568691.423340:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976251008 00000100:00100000:2.0:1788568691.423344:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976251008 00000100:00100000:2.0:1788568691.423359:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788568691.423365:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+18:11683:x1875449976251008:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788568691.423485:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+18:11683:x1875449976251008:12345-0@lo:502:llog_process_th.0 Request processed in 118us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568691.423491:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788568691.423518:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae26fb73c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788568691.423530:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244b2e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:11683:1875449976251008:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788568691.423547:0:11683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788568691.423551:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788568691.423552:0:11683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788568691.423556:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788568691.423614:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788568691.425142:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788568691.425163:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a800/0x41e82f464b6a0f93 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0f9a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568691.425177:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a800/0x41e82f464b6a0f93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0f9a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788568691.425189:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788568691.425192:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae26b352000 from 7 10000000:01000000:2.0:1788568691.425196:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788568691.425239:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a400/0x41e82f464b6a0fa1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568691.425247:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a400/0x41e82f464b6a0fa1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568691.425259:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a400/0x41e82f464b6a0fa1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568691.425288:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244b2e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976251136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788568691.425356:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568691.425404:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae26fb73c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788568691.425437:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976251136 00000100:00100000:2.0:1788568691.425444:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976251136 00000100:00100000:2.0:1788568691.425484:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788568691.425492:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+18:5838:x1875449976251136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788568691.425505:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568691.425519:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae252e7ba00/0x41e82f464b6a0fa8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a0fa1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568691.425559:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae252e7ba00/0x41e82f464b6a0fa8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a0fa1 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568691.425570:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae252e7ba00/0x41e82f464b6a0fa8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a0fa1 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568691.425580:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7ba00, rc 0) 00000100:00100000:2.0:1788568691.425618:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+19:5838:x1875449976251136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568691.425626:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788568691.425673:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244b2e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976251136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788568691.425688:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a400/0x41e82f464b6a0fa1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0fa8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568691.425698:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a400/0x41e82f464b6a0fa1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0fa8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568691.428952:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244b2e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976251264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788568691.429045:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568691.429097:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae26fb73c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788568691.429301:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976251264 00000100:00100000:0.0:1788568691.429311:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976251264 00000100:00100000:0.0:1788568691.429365:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788568691.429376:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+19:5838:x1875449976251264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788568691.429742:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+19:5838:x1875449976251264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 367us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568691.429751:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788568691.429808:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244b2e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976251264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788568691.429866:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae14350d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976251392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788568691.429908:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568691.429946:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976251392 00000100:00100000:0.0:1788568691.429950:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976251392 00000100:00100000:0.0:1788568691.429970:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788568691.429976:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+19:5838:x1875449976251392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788568691.430122:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+19:5838:x1875449976251392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568691.430129:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788568691.430168:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27fd4d600 going to sleep for 11 seconds 00000100:00100000:0.0:1788568691.430187:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae14350d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:925db6b8-84bc-418c-b37a-40345c1020be:5838:1875449976251392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788568691.430416:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae14350d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:11684:1875449976251520:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788568691.430462:0:11684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568691.430482:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976251520 00000100:00100000:0.0:1788568691.430486:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976251520 00000100:00100000:0.0:1788568691.430505:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788568691.430511:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+19:11684:x1875449976251520:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788568691.430646:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+19:11684:x1875449976251520:12345-0@lo:502:llog_process_th.0 Request processed in 134us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568691.430653:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788568691.430684:0:11684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2487eba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788568691.430696:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae14350d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:11684:1875449976251520:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788568691.430720:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788568691.430731:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788568691.430733:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788568691.430741:0:11684:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ae26b352000 00000020:00000080:0.0:1788568691.430744:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788568691.430837:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae14350d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:11684:1875449976251648:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788568691.430869:0:11684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568691.430887:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976251648 00000100:00100000:0.0:1788568691.430891:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976251648 00000100:00100000:0.0:1788568691.430911:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788568691.430917:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+19:11684:x1875449976251648:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788568691.431565:0:11684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae142abae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788568691.431776:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+19:11684:x1875449976251648:12345-0@lo:502:llog_process_th.0 Request processed in 857us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568691.431785:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788568691.434087:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae14350d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:925db6b8-84bc-418c-b37a-40345c1020be:11684:1875449976251648:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788568691.434145:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788568691.434155:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788568691.434158:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788568691.434163:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788568691.437569:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788568691.437619:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788568691.437634:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a400/0x41e82f464b6a0fa1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0fa8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568691.437649:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a400/0x41e82f464b6a0fa1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0fa8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788568691.448025:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788568691.895113:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568692.215313:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26fa20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875449976252032:0@lo:400:kworker.0 00000100:00100000:1.0:1788568692.215454:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568692.215543:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788568692.215550:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26fa20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875449976251904:0@lo:400:kworker.0 00000100:00100000:1.0:1788568692.215576:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568692.215594:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26fa21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976252416:0@lo:400:kworker.0 00000100:00100000:1.0:1788568692.215619:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568692.215964:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26fa20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925db6b8-84bc-418c-b37a-40345c1020be:3309:1875449976251776:0@lo:400:kworker.0 00000100:00100000:3.0:1788568692.216009:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568692.216039:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26fa23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875449976252288:0@lo:400:kworker.0 00000100:00100000:3.0:1788568692.216062:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568692.216091:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788568692.216098:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26fa23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976252160:0@lo:400:kworker.0 00000100:00100000:3.0:1788568692.216122:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568692.216157:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976252416 00000100:00100000:3.0:1788568692.216167:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976252416 00000100:00100000:3.0:1788568692.216234:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976252160 00000100:00100000:3.0:1788568692.216237:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976252160 00000100:00100000:3.0:1788568692.216264:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788568692.216274:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976252416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568692.216347:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976252416:12345-0@lo:400:kworker.0 Request processed in 74us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568692.216354:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788568692.216373:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788568692.216390:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1875449976252160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568692.216422:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1875449976252160:12345-0@lo:400:kworker.0 Request processed in 44us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568692.216428:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788568692.216480:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26fa23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976252160:0@lo:400:kworker.0 00000100:00100000:0.0:1788568692.216661:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976252032 00000100:00100000:0.0:1788568692.216666:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976252032 00000100:00100000:0.0:1788568692.216709:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976251904 00000100:00100000:0.0:1788568692.216713:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976251904 00000100:00100000:0.0:1788568692.216727:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976252288 00000100:00100000:0.0:1788568692.216729:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976252288 00000100:00100000:0.0:1788568692.216744:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788568692.216750:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875449976252032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568692.216792:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875449976252032:12345-0@lo:400:kworker.0 Request processed in 43us (1339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568692.216799:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788568692.216812:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788568692.216817:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875449976251904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568692.216844:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875449976251904:12345-0@lo:400:kworker.0 Request processed in 27us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568692.216850:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788568692.216861:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788568692.216867:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875449976252288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568692.216898:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875449976252288:12345-0@lo:400:kworker.0 Request processed in 31us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568692.216916:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:0.0:1788568692.216978:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788568692.216983:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788568692.216986:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788568692.217464:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976251776 00000100:00100000:1.0:1788568692.217472:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976251776 00000100:00100000:1.0:1788568692.217518:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788568692.217527:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+19:3309:x1875449976251776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568692.217575:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+19:3309:x1875449976251776:12345-0@lo:400:kworker.0 Request processed in 51us (1565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568692.217582:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788568692.217642:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26fa20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875449976251904:0@lo:400:kworker.0 00010000:00080000:1.0:1788568692.217660:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae26fa21500 x1875449976252416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568692.217672:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26fa21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976252416:0@lo:400:kworker.0 00000100:00100000:1.0:1788568692.217684:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26fa20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875449976252032:0@lo:400:kworker.0 00000100:00100000:3.0:1788568692.217838:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26fa20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925db6b8-84bc-418c-b37a-40345c1020be:3309:1875449976251776:0@lo:400:kworker.0 00000100:00100000:3.0:1788568692.217852:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26fa23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875449976252288:0@lo:400:kworker.0 00000040:00080000:1.0:1788568692.473713:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788568692.728758:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244b2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976252544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788568692.728860:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568692.729042:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976252544 00000100:00100000:2.0:1788568692.729052:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976252544 00000100:00100000:2.0:1788568692.729118:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788568692.729130:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976252544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788568692.729184:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788568692.729249:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976252544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568692.729257:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1788568692.729922:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae244b2f100 x1875449976252544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568708 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568692.729972:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244b2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976252544:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788568692.919447:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568693.241142:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244b36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976252672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788568693.241243:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568693.241641:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976252672 00000100:00100000:2.0:1788568693.241654:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976252672 00000100:00100000:2.0:1788568693.241721:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788568693.241734:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae14350ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875449976252672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788568693.241779:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788568693.241854:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae14350ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875449976252672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568693.241861:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788568693.241957:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244b36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976252672:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1788568693.842609:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:2.0:1788568693.945015:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568694.969537:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568695.313507:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568695.313622:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568695.313676:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568695.313716:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568695.313769:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958391040 00000100:00100000:3.0:1788568695.313770:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958391296 00000100:00100000:3.0:1788568695.313784:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958391296 00000100:00100000:2.0:1788568695.313784:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958391040 00000100:00100000:2.0:1788568695.313854:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 277 00000100:00100000:2.0:1788568695.313870:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+13:2363:x1875449958391040:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:0.0:1788568695.313918:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958391168 00000100:00100000:2.0:1788568695.313986:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+13:2363:x1875449958391040:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 122us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568695.313996:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 277 00000100:00100000:0.0:1788568695.314103:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958391168 00000100:00100000:0.0:1788568695.314179:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958391424 00000100:00100000:0.0:1788568695.314184:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958391424 00000100:00080000:2.0:1788568695.314199:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788568695.314221:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 112 00000100:00100000:0.0:1788568695.314235:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2363:x1875449958391168:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:2.0:1788568695.314238:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 113 00000100:00100000:2.0:1788568695.314267:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2363:x1875449958391424:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:0.0:1788568695.315078:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2363:x1875449958391168:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 838us (1579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568695.315098:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 112 00000100:00100000:3.0:1788568695.315532:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 64 00000100:00100000:3.0:1788568695.315548:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2363:x1875449958391296:12345-192.168.206.4@tcp:400:kworker.0 00000100:00080000:1.0:1788568695.315635:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788568695.321029:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2363:x1875449958391424:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 6754us (7393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568695.321223:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 113 00000100:00100000:3.0:1788568695.329678:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2363:x1875449958391296:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 14116us (15941us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568695.329698:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 64 00010000:00010000:3.0:1788568695.991221:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568697.017108:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568697.336148:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae14350e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976252928:0@lo:400:kworker.0 00000100:00100000:2.0:1788568697.336258:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568697.336340:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae14350c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976253440:0@lo:400:kworker.0 00000100:00100000:2.0:1788568697.336383:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568697.336417:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788568697.336423:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae14350c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875449976253056:0@lo:400:kworker.0 00000100:00100000:2.0:1788568697.336455:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568697.336499:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976252928 00000100:00100000:2.0:1788568697.336508:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976252928 00000100:00100000:2.0:1788568697.336559:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976253056 00000100:00100000:2.0:1788568697.336563:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976253056 00000100:00100000:2.0:1788568697.336597:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788568697.336607:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976252928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568697.336669:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976252928:12345-0@lo:400:kworker.0 Request processed in 63us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568697.336677:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788568697.336696:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788568697.336703:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875449976253056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568697.336821:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875449976253056:12345-0@lo:400:kworker.0 Request processed in 118us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568697.336829:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788568697.336900:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae14350c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875449976253056:0@lo:400:kworker.0 00000100:00100000:2.0:1788568697.336915:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae14350e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976252928:0@lo:400:kworker.0 00000100:00100000:3.0:1788568697.337341:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae14350f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925db6b8-84bc-418c-b37a-40345c1020be:3309:1875449976252800:0@lo:400:kworker.0 00000100:00100000:3.0:1788568697.337401:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568697.337448:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae14350ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875449976253312:0@lo:400:kworker.0 00000100:00100000:3.0:1788568697.337478:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568697.337503:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788568697.337510:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae14350df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976253184:0@lo:400:kworker.0 00000100:00100000:3.0:1788568697.337535:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568697.337573:0:8111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976253440 00000100:00100000:3.0:1788568697.337578:0:8111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976253440 00000100:00100000:3.0:1788568697.337618:0:8111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976253184 00000100:00100000:3.0:1788568697.337621:0:8111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976253184 00000100:00100000:3.0:1788568697.337645:0:8111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788568697.337652:0:8111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976253440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568697.337703:0:8111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976253440:12345-0@lo:400:kworker.0 Request processed in 51us (1319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568697.337710:0:8111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788568697.337725:0:8111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788568697.337785:0:8111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fa20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976253184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568697.337820:0:8111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fa20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976253184:12345-0@lo:400:kworker.0 Request processed in 90us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568697.337826:0:8111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788568697.337862:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1788568697.337868:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ae141c31180, transno 4294967300 00000100:00100000:3.0:1788568697.337881:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae14350df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976253184:0@lo:400:kworker.0 00000100:00100000:1.0:1788568697.338640:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976253312 00000100:00100000:1.0:1788568697.338650:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976253312 00000100:00100000:1.0:1788568697.338700:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788568697.338708:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fa23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875449976253312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568697.338784:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fa23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875449976253312:12345-0@lo:400:kworker.0 Request processed in 77us (1305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568697.338792:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:1.0:1788568697.338813:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788568697.338817:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788568697.338821:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788568697.338881:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae14350ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875449976253312:0@lo:400:kworker.0 00000100:00100000:2.0:1788568697.339558:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976252800 00000100:00100000:2.0:1788568697.339565:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976252800 00000100:00100000:2.0:1788568697.339610:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1788568697.339618:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+19:3309:x1875449976252800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568697.339684:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+19:3309:x1875449976252800:12345-0@lo:400:kworker.0 Request processed in 67us (2282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568697.339691:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00010000:00080000:2.0:1788568697.339757:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae14350c000 x1875449976253440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568697.339771:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae14350c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976253440:0@lo:400:kworker.0 00000100:00100000:1.0:1788568697.341163:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae14350f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925db6b8-84bc-418c-b37a-40345c1020be:3309:1875449976252800:0@lo:400:kworker.0 00000100:00100000:2.0:1788568697.847661:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788568697.847683:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244b2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976253568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788568697.847754:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568697.847797:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976253568 00000100:00100000:0.0:1788568697.847811:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976253568 00000100:00100000:0.0:1788568697.849013:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788568697.849035:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976253568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788568697.849088:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788568697.849186:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976253568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 159us (1431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568697.849194:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1788568697.849366:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae244b2d180 x1875449976253568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568713 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568697.849395:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244b2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976253568:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788568698.039637:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568698.360725:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae14350f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976253696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788568698.360797:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568698.360867:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976253696 00000100:00100000:3.0:1788568698.360874:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976253696 00000100:00100000:3.0:1788568698.360922:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788568698.360946:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fa20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976253696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788568698.360986:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788568698.361039:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fa20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976253696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568698.361055:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788568698.361131:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae14350f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976253696:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788568699.063308:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568700.092169:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568700.432805:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568700.432871:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568700.432915:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568700.433253:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958391552 00000100:00100000:3.0:1788568700.433267:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958391552 00000100:00100000:3.0:1788568700.433359:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 279 00000100:00100000:3.0:1788568700.433373:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+13:2364:x1875449958391552:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:3.0:1788568700.433480:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+13:2364:x1875449958391552:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 111us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568700.433489:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 279 00000100:00100000:0.0:1788568700.436757:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958391680 00000100:00100000:0.0:1788568700.436772:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958391680 00000100:00100000:0.0:1788568700.436863:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958391936 00000100:00100000:0.0:1788568700.436866:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958391936 00000100:00100000:0.0:1788568700.436898:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 117 00000100:00100000:0.0:1788568700.436909:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2363:x1875449958391680:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:0.0:1788568700.437011:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2363:x1875449958391680:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 105us (4221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568700.437019:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 117 00000100:00100000:0.0:1788568700.437036:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 118 00000100:00100000:0.0:1788568700.437043:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2363:x1875449958391936:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:0.0:1788568700.437067:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2363:x1875449958391936:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 24us (4151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568700.437073:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 118 00000100:00080000:2.0:1788568700.437190:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788568700.443820:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568700.443893:0:8111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958391808 00000100:00100000:3.0:1788568700.443902:0:8111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958391808 00000100:00100000:3.0:1788568700.443992:0:8111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 67 00000100:00100000:3.0:1788568700.444002:0:8111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae14350f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2364:x1875449958391808:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:3.0:1788568700.444071:0:8111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae14350f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2364:x1875449958391808:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 71us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568700.444078:0:8111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 67 00000100:00080000:2.0:1788568700.444152:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788568701.111483:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568702.136730:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568702.455286:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae14350c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976253952:0@lo:400:kworker.0 00000100:00100000:2.0:1788568702.455364:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568702.455427:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae14350c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976254464:0@lo:400:kworker.0 00000100:00100000:1.0:1788568702.455431:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae14350f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925db6b8-84bc-418c-b37a-40345c1020be:3309:1875449976253824:0@lo:400:kworker.0 00000100:00100000:2.0:1788568702.455451:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568702.455461:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568702.455478:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae14350e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875449976254336:0@lo:400:kworker.0 00000100:00100000:2.0:1788568702.455479:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788568702.455484:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae14350ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875449976254080:0@lo:400:kworker.0 00000100:00100000:1.0:1788568702.455498:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568702.455523:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788568702.455526:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568702.455528:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae14350df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976254208:0@lo:400:kworker.0 00000100:00100000:1.0:1788568702.455548:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568702.455557:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976253952 00000100:00100000:2.0:1788568702.455563:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976253952 00000100:00100000:1.0:1788568702.455571:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976254464 00000100:00100000:1.0:1788568702.455574:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976254464 00000100:00100000:2.0:1788568702.455601:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976254336 00000100:00100000:2.0:1788568702.455604:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976254336 00000100:00100000:1.0:1788568702.455604:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976254208 00000100:00100000:1.0:1788568702.455606:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976254208 00000100:00100000:2.0:1788568702.455615:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976254080 00000100:00100000:2.0:1788568702.455617:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976254080 00000100:00100000:1.0:1788568702.455622:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788568702.455629:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788568702.455636:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976253952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568702.455639:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976254464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568702.455715:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788568702.455724:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976254208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568702.455763:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976254208:12345-0@lo:400:kworker.0 Request processed in 41us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568702.455770:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788568702.455794:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788568702.455801:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875449976254336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568702.455829:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875449976254336:12345-0@lo:400:kworker.0 Request processed in 29us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568702.455835:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788568702.455849:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788568702.455863:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875449976254080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568702.455907:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976253952:12345-0@lo:400:kworker.0 Request processed in 270us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568702.455914:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788568702.456097:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976253824 00000100:00100000:3.0:1788568702.456102:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976253824 00000100:00100000:3.0:1788568702.456131:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1788568702.456138:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+19:3309:x1875449976253824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568702.456172:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+19:3309:x1875449976253824:12345-0@lo:400:kworker.0 Request processed in 35us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568702.456178:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00080000:3.0:1788568702.456221:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788568702.456226:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788568702.456228:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788568702.456261:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae14350df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976254208:0@lo:400:kworker.0 00000100:00100000:3.0:1788568702.456273:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae14350f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925db6b8-84bc-418c-b37a-40345c1020be:3309:1875449976253824:0@lo:400:kworker.0 00000100:00100000:3.0:1788568702.456282:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae14350e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875449976254336:0@lo:400:kworker.0 00000100:00100000:1.0:1788568702.457634:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976254464:12345-0@lo:400:kworker.0 Request processed in 1987us (2173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568702.457645:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788568702.460708:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875449976254080:12345-0@lo:400:kworker.0 Request processed in 4835us (5170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568702.460725:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788568702.467866:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae14350ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875449976254080:0@lo:400:kworker.0 00000100:00100000:2.0:1788568702.467896:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae14350c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976253952:0@lo:400:kworker.0 00010000:00080000:2.0:1788568702.467911:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae14350c380 x1875449976254464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568702.467921:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae14350c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976254464:0@lo:400:kworker.0 00000040:00080000:2.0:1788568702.712976:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788568702.967223:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976254592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788568702.967299:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568702.967364:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976254592 00000100:00100000:0.0:1788568702.967372:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976254592 00000100:00100000:0.0:1788568702.967419:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788568702.967429:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976254592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788568702.967462:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788568702.967517:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976254592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568702.967524:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1788568702.967607:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae244b2ce00 x1875449976254592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568718 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568702.967625:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976254592:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788568703.161467:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568703.479268:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae14350d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976254720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788568703.479376:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568703.479600:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976254720 00000100:00100000:2.0:1788568703.479609:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976254720 00000100:00100000:2.0:1788568703.479668:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788568703.479676:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fa21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976254720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788568703.479710:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788568703.479760:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fa21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976254720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568703.479773:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788568703.480062:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae14350d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976254720:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788568704.184311:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568705.207208:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568705.563259:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568705.563306:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568705.563405:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568705.563508:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958392320 00000100:00100000:3.0:1788568705.563520:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958392320 00000100:00100000:3.0:1788568705.563597:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 19 00000100:00100000:3.0:1788568705.563608:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae14350c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2360:x1875449958392320:12345-192.168.206.4@tcp:9:kworker.0 00000020:00000080:3.0:1788568705.563638:0:6691:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x41e82f464b6a0ee4 00000100:00080000:3.0:1788568705.563647:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9ae277a7b800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788568705.563685:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1788568705.563968:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae14350c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+2:2360:x1875449958392320:12345-192.168.206.4@tcp:9:kworker.0 Request processed in 362us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568705.563976:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 19 00010000:00010000:3.0:1788568705.563995:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568705.564067:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958392192 00000100:00100000:1.0:1788568705.564071:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958392192 00000100:00100000:1.0:1788568705.564122:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 122 00000100:00100000:1.0:1788568705.564129:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae14350d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2361:x1875449958392192:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:1.0:1788568705.564160:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae14350d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2361:x1875449958392192:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 32us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568705.564165:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 122 00000100:00100000:2.0:1788568705.564306:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958392064 00000100:00100000:2.0:1788568705.564320:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958392064 00000100:00100000:2.0:1788568705.564361:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 281 00000100:00100000:2.0:1788568705.564368:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+13:2361:x1875449958392064:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:2.0:1788568705.564393:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+13:2361:x1875449958392064:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 27us (1145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568705.564399:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 281 00000100:00080000:0.0:1788568705.564681:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788568705.564686:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788568705.565489:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568705.565551:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958392448 00000100:00100000:3.0:1788568705.565558:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958392448 00000100:00100000:3.0:1788568705.565606:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 123 00000100:00100000:3.0:1788568705.565614:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2362:x1875449958392448:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:3.0:1788568705.565665:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2362:x1875449958392448:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 52us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568705.565672:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 123 00000100:00080000:0.0:1788568705.565848:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788568706.235678:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568707.255878:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568707.575372:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925db6b8-84bc-418c-b37a-40345c1020be:3309:1875449976254848:0@lo:400:kworker.0 00000100:00100000:1.0:1788568707.575446:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568707.575590:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976254848 00000100:00100000:3.0:1788568707.575599:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976254848 00000100:00100000:3.0:1788568707.575649:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788568707.575659:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+19:3309:x1875449976254848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568707.575717:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+19:3309:x1875449976254848:12345-0@lo:400:kworker.0 Request processed in 60us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568707.575739:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788568707.576137:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925db6b8-84bc-418c-b37a-40345c1020be:3309:1875449976254848:0@lo:400:kworker.0 00000100:00100000:0.0:1788568707.576340:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244b2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976255232:0@lo:400:kworker.0 00000100:00100000:0.0:1788568707.576379:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568707.576440:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244b2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976254976:0@lo:400:kworker.0 00000100:00100000:3.0:1788568707.576470:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568707.576489:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788568707.576493:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244b2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875449976255104:0@lo:400:kworker.0 00000100:00100000:3.0:1788568707.576513:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568707.576541:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976254976 00000100:00100000:3.0:1788568707.576545:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976254976 00000100:00100000:3.0:1788568707.576576:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976255104 00000100:00100000:3.0:1788568707.576580:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976255104 00000100:00100000:3.0:1788568707.576608:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788568707.576614:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fa20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976254976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568707.576656:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fa20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976254976:12345-0@lo:400:kworker.0 Request processed in 42us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568707.576663:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788568707.576678:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788568707.576684:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fa23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875449976255104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568707.576711:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fa23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875449976255104:12345-0@lo:400:kworker.0 Request processed in 28us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568707.576717:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788568707.576749:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244b2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875449976255104:0@lo:400:kworker.0 00000100:00100000:3.0:1788568707.576954:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244b2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976254976:0@lo:400:kworker.0 00000100:00100000:1.0:1788568707.577063:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244b2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875449976255360:0@lo:400:kworker.0 00000100:00100000:1.0:1788568707.577093:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568707.577139:0:8111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976255232 00000100:00100000:1.0:1788568707.577153:0:8111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976255232 00000100:00100000:1.0:1788568707.577186:0:8111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788568707.577192:0:8111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae14350c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976255232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568707.577252:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976255360 00000100:00100000:3.0:1788568707.577256:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976255360 00000100:00100000:3.0:1788568707.577282:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788568707.577483:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875449976255360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568707.577526:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875449976255360:12345-0@lo:400:kworker.0 Request processed in 230us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568707.577532:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:3.0:1788568707.577657:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788568707.577661:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788568707.577988:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244b2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976255488:0@lo:400:kworker.0 00000100:00100000:3.0:1788568707.578030:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568707.578070:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976255488 00000100:00100000:3.0:1788568707.578074:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976255488 00000100:00100000:3.0:1788568707.578106:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788568707.578114:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976255488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568707.578149:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976255488:12345-0@lo:400:kworker.0 Request processed in 36us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568707.578155:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1788568707.578171:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788568707.578191:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae244b2df80 x1875449976255488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568707.578203:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244b2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976255488:0@lo:400:kworker.0 00000100:00100000:3.0:1788568707.578236:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244b2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875449976255360:0@lo:400:kworker.0 00000100:00100000:1.0:1788568707.578499:0:8111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae14350c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976255232:12345-0@lo:400:kworker.0 Request processed in 1305us (2118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568707.578507:0:8111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788568707.578561:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244b2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976255232:0@lo:400:kworker.0 00000100:00100000:3.0:1788568708.087354:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244b2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976255616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788568708.087650:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568708.091374:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976255616 00000100:00100000:2.0:1788568708.091389:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976255616 00000100:00100000:2.0:1788568708.091469:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788568708.091479:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fec6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976255616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788568708.091525:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788568708.092171:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fec6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976255616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 690us (4519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568708.092179:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1788568708.092345:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae244b2f480 x1875449976255616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568724 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568708.092364:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244b2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976255616:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788568708.279229:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568708.599415:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788568708.599441:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae14350ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976255744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788568708.599517:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568708.599831:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976255744 00000100:00100000:0.0:1788568708.599840:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976255744 00000100:00100000:0.0:1788568708.599906:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788568708.599916:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976255744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788568708.599973:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788568708.600105:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976255744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 190us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568708.600113:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788568708.600211:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae14350ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976255744:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1788568709.189276:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 27f83c0c-e36b-48ce-9485-80051fd252dc 00000020:00000080:3.0:1788568709.189285:0:6717:0:(genops.c:885:class_export_put()) final put ffff9ae277a79800/27f83c0c-e36b-48ce-9485-80051fd252dc 00000020:00000080:0.0:1788568709.189365:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae277a79800/27f83c0c-e36b-48ce-9485-80051fd252dc for lustre-OST0000 00000020:00000080:0.0:1788568709.189416:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae277a7b800 for lustre-OST0000 00010000:00010000:3.0:1788568709.303120:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568710.328526:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568710.674278:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568710.674349:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568710.674389:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568710.674426:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958392576 00000100:00100000:0.0:1788568710.674440:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958392704 00000100:00100000:3.0:1788568710.674442:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958392576 00000100:00100000:0.0:1788568710.674452:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958392704 00000100:00100000:3.0:1788568710.674528:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 283 00000100:00100000:0.0:1788568710.674531:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958392832 00000100:00100000:0.0:1788568710.674537:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958392832 00000100:00100000:3.0:1788568710.674547:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae250449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+13:2361:x1875449958392576:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:0.0:1788568710.674572:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 127 00000100:00100000:0.0:1788568710.674585:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae14350e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2361:x1875449958392704:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:3.0:1788568710.674650:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae250449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+13:2361:x1875449958392576:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 105us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568710.674669:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 283 00000100:00100000:0.0:1788568710.674669:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae14350e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2361:x1875449958392704:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 78us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568710.674685:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 127 00000100:00100000:0.0:1788568710.674707:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 128 00000100:00100000:0.0:1788568710.674716:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae14350f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2361:x1875449958392832:12345-192.168.206.4@tcp:400:kworker.0 00000100:00080000:3.0:1788568710.674730:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788568710.674752:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae14350f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2361:x1875449958392832:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 36us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568710.674762:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 128 00010000:00010000:0.0:1788568711.351512:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568712.375255:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568712.695734:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788568712.697791:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244b2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976256000:0@lo:400:kworker.0 00000100:00100000:0.0:1788568712.697898:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568712.698495:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788568712.698506:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244b2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875449976256128:0@lo:400:kworker.0 00000100:00100000:0.0:1788568712.698542:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568712.698608:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976256000 00000100:00100000:0.0:1788568712.698619:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976256000 00000100:00100000:0.0:1788568712.698691:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976256128 00000100:00100000:0.0:1788568712.698695:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976256128 00000100:00100000:0.0:1788568712.698734:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788568712.698744:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae14350df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976256000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568712.699121:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae14350df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976256000:12345-0@lo:400:kworker.0 Request processed in 67us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568712.699132:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788568712.699156:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788568712.699164:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae14350ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875449976256128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568712.699198:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae14350ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875449976256128:12345-0@lo:400:kworker.0 Request processed in 35us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568712.699204:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:0.0:1788568712.699227:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788568712.699284:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244b2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875449976256128:0@lo:400:kworker.0 00000100:00100000:0.0:1788568712.699299:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244b2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976256000:0@lo:400:kworker.0 00000100:00100000:1.0:1788568712.702314:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976256256:0@lo:400:kworker.0 00000100:00100000:1.0:1788568712.702391:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568712.702450:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244b2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:925db6b8-84bc-418c-b37a-40345c1020be:3308:1875449976255872:0@lo:400:kworker.0 00000100:00100000:1.0:1788568712.702492:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568712.702713:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976255872 00000100:00100000:1.0:1788568712.702723:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976255872 00000100:00100000:1.0:1788568712.702769:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788568712.702778:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae250449450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+19:3308:x1875449976255872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568712.702913:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae250449450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+19:3308:x1875449976255872:12345-0@lo:400:kworker.0 Request processed in 135us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568712.702922:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788568712.702995:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244b2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:925db6b8-84bc-418c-b37a-40345c1020be:3308:1875449976255872:0@lo:400:kworker.0 00000100:00100000:0.0:1788568712.703480:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976256256 00000100:00100000:0.0:1788568712.703494:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976256256 00000100:00100000:0.0:1788568712.703568:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788568712.703580:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976256256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568712.703710:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976256256:12345-0@lo:400:kworker.0 Request processed in 133us (1318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568712.703719:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788568712.703745:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976256256:0@lo:400:kworker.0 00000100:00080000:0.0:1788568712.703762:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788568712.706368:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875449976256384:0@lo:400:kworker.0 00000100:00100000:0.0:1788568712.706472:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568712.706589:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976256384 00000100:00100000:1.0:1788568712.706597:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976256384 00000100:00100000:1.0:1788568712.706671:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788568712.706681:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875449976256384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568712.708348:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788568712.708372:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244b2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976256512:0@lo:400:kworker.0 00000100:00100000:2.0:1788568712.708461:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568712.708530:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976256512 00000100:00100000:2.0:1788568712.708538:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976256512 00000100:00100000:2.0:1788568712.708605:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788568712.708615:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976256512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568712.708670:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976256512:12345-0@lo:400:kworker.0 Request processed in 57us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568712.708677:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:2.0:1788568712.708721:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae244b2df80 x1875449976256512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568712.708736:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244b2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976256512:0@lo:400:kworker.0 00000100:00080000:2.0:1788568712.708792:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788568712.708797:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788568712.713071:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875449976256384:12345-0@lo:400:kworker.0 Request processed in 6379us (6587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568712.713088:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788568712.713391:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875449976256384:0@lo:400:kworker.0 00000040:00080000:3.0:1788568712.952000:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788568713.208980:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27fec4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976256640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788568713.209087:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568713.210143:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976256640 00000100:00100000:0.0:1788568713.210158:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976256640 00000100:00100000:0.0:1788568713.210239:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788568713.210251:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976256640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788568713.210314:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788568713.210406:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976256640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 157us (1319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568713.210414:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1788568713.212517:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae27fec4a80 x1875449976256640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568729 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568713.212552:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27fec4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976256640:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788568713.399795:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788568713.408404:0:11853:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 20:38:30 (1788568710) 00000100:00100000:2.0:1788568713.719180:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976256768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788568713.719259:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568713.719524:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976256768 00000100:00100000:0.0:1788568713.719532:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976256768 00000100:00100000:0.0:1788568713.719583:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788568713.719594:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976256768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788568713.719626:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788568713.719681:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976256768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568713.719688:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788568713.719775:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976256768:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788568714.424113:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568715.195128:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568715.195240:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958392960 00000100:00100000:3.0:1788568715.195249:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958392960 00000100:00100000:3.0:1788568715.195512:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 32 00000100:00100000:3.0:1788568715.195527:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+5:10236:x1875449958392960:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788568715.195546:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568715.195611:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a0faf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bead2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568715.195681:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a0fb6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568715.195705:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a0fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568715.195718:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a0fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788568715.195749:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788568715.195753:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788568715.195799:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a0fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568715.195952:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a0faf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bead2 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568715.195971:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a0fb6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bead2 expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568715.195980:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae2430add00) 00010000:00010000:3.0:1788568715.196112:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788568715.196116:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429df400, rc 0) 00000100:00100000:3.0:1788568715.196174:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+6:10236:x1875449958392960:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 652us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568715.196181:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 32 00000100:00080000:0.0:1788568715.199392:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788568715.203740:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568715.205439:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958393088 00000100:00100000:0.0:1788568715.205464:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958393088 00000100:00100000:0.0:1788568715.205533:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 33 00000100:00100000:0.0:1788568715.205543:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fec4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+6:10237:x1875449958393088:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788568715.205563:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568715.205582:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabc00/0x41e82f464b6a0fbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bead9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568715.205640:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a0fc4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568715.205653:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a0fc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568715.205664:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a0fc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568715.205691:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a0fcb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568715.205698:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a0fcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568715.205704:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a0fcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568715.205916:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab600/0x41e82f464b6a0fd2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568715.205964:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab600/0x41e82f464b6a0fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568715.205980:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab600/0x41e82f464b6a0fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788568715.206238:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788568715.206242:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788568715.206273:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab600/0x41e82f464b6a0fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568715.206389:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a0fc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568715.206397:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a0fc4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568715.206404:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a0fc4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568715.206411:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feab000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568715.206415:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a0fc4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568715.206422:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a0fc4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568715.206433:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae2430add00) 00010000:00010000:0.0:1788568715.206436:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788568715.206442:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a0fc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568715.206448:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a0fc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568715.206472:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a0fcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568715.206478:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a0fcb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568715.206483:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a0fcb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568715.206488:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaa200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568715.206490:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a0fcb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568715.206496:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a0fcb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568715.206503:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9ae24515a800) 00010000:00010000:0.0:1788568715.206505:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788568715.206509:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a0fcb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568715.206514:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a0fcb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568715.206547:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabc00/0x41e82f464b6a0fbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bead9 expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568715.206560:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab600/0x41e82f464b6a0fd2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bead9 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568715.206579:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ae24515a400) 00010000:00010000:0.0:1788568715.206581:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788568715.206584:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae27feab600, rc 0) 00000100:00100000:0.0:1788568715.206657:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fec4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+7:10237:x1875449958393088:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 1114us (2925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568715.206665:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 33 00000100:00100000:3.0:1788568715.215150:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568715.216214:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958393344 00000100:00100000:0.0:1788568715.216225:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958393344 00000100:00100000:0.0:1788568715.216301:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 34 00000100:00100000:0.0:1788568715.216311:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae1419be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+7:10237:x1875449958393344:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788568715.216330:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568715.216351:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a0fd9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beae0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568715.216420:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a0fe0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568715.216434:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a0fe0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568715.216444:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a0fe0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568715.216507:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a0fe7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568715.216514:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a0fe7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568715.216539:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a0fe7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568715.218699:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0fee lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568715.218720:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0fee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568715.218731:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0fee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568715.218747:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788568715.219128:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a0fe0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568715.219136:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a0fe0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568715.219143:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a0fe0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568715.219148:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feabe00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568715.219152:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a0fe0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568715.219159:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a0fe0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568715.219172:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ae24515a400) 00010000:00010000:1.0:1788568715.219186:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568715.219191:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a0fe0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568715.219198:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a0fe0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568715.219213:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a0fe7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568715.219218:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a0fe7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568715.219224:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a0fe7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568715.219228:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaa800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568715.219231:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a0fe7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568715.219236:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a0fe7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568715.219243:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ae24515a200) 00010000:00010000:1.0:1788568715.219246:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568715.219249:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a0fe7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568715.219254:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a0fe7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568715.220418:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a0fd9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beae0 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568715.220459:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0fee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beae0 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568715.220468:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ae25820cd00) 00010000:00010000:1.0:1788568715.220471:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568715.220474:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae282044000, rc 0) 00000100:00100000:1.0:1788568715.220867:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae1419be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+9:10237:x1875449958393344:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 4555us (5725us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788568715.220876:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 34 00000100:00100000:1.0:1788568715.227708:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568715.227902:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958393472 00000100:00100000:0.0:1788568715.227911:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958393472 00000100:00100000:2.0:1788568715.228122:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 35 00000100:00100000:2.0:1788568715.228134:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+9:10237:x1875449958393472:12345-192.168.206.4@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788568715.228235:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+9:10237:x1875449958393472:12345-192.168.206.4@tcp:59:lhsmtool_posix.0 Request processed in 104us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568715.228243:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 35 00010000:00010000:0.0:1788568715.448134:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568715.792586:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568715.792633:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568715.792674:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958393600 00000100:00100000:0.0:1788568715.792685:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958393600 00000100:00100000:0.0:1788568715.792738:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 285 00000100:00100000:0.0:1788568715.792748:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+13:2363:x1875449958393600:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:0.0:1788568715.792808:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+13:2363:x1875449958393600:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 61us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568715.792816:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 285 00000100:00100000:2.0:1788568715.792891:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958393728 00000100:00100000:2.0:1788568715.792896:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958393728 00000100:00100000:2.0:1788568715.792974:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 132 00000100:00100000:2.0:1788568715.792982:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae1419bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2363:x1875449958393728:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:2.0:1788568715.793013:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae1419bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2363:x1875449958393728:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 32us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568715.793020:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 132 00000100:00080000:0.0:1788568715.794088:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1788568716.024191:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788568716.471763:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568717.196235:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568717.196318:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958393856 00000100:00100000:0.0:1788568717.196327:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958393856 00000100:00100000:0.0:1788568717.196394:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 36 00000100:00100000:0.0:1788568717.196405:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae1419bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+9:10279:x1875449958393856:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:0.0:1788568717.196423:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568717.196442:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a0ffc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beae7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.196501:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1003 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.196515:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1003 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.196543:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1003 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.196558:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a100a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.196565:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a100a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.196570:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a100a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.196740:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1003 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.196747:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1003 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.196753:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1003 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.196759:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaa800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568717.196763:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1003 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.196770:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1003 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.196782:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae2430add00) 00010000:00010000:0.0:1788568717.196785:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788568717.196790:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1003 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.196880:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1003 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.196891:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a100a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.196897:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a100a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.196902:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a100a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.196906:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaa400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568717.196909:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a100a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.196915:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a100a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.197012:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ae24515a000) 00010000:00010000:0.0:1788568717.197015:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788568717.197019:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a100a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.197025:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a100a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.197057:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a0ffc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beae7 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.197080:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae2430add00) 00010000:00010000:0.0:1788568717.197082:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788568717.197087:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a0ffc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beae7 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.197096:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae27feabe00, rc 0) 00000100:00100000:0.0:1788568717.197299:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae1419bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+9:10279:x1875449958393856:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 895us (1182us total) trans 0 rc 301/301 00000100:00100000:0.0:1788568717.197307:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 36 00000100:00080000:3.0:1788568717.197487:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788568717.200495:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568717.200876:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958394112 00000100:00100000:3.0:1788568717.200886:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958394112 00000100:00100000:3.0:1788568717.200971:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 37 00000100:00100000:3.0:1788568717.200981:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+9:10279:x1875449958394112:12345-192.168.206.4@tcp:36:lfs.0 00010000:00010000:3.0:1788568717.201029:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568717.201056:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a0fb6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bead2 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568717.201073:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae2430add00) 00010000:00010000:3.0:1788568717.201084:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788568717.201293:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1011 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568717.201307:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1011 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568717.201316:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1011 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568717.201328:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1018 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568717.201335:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1018 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568717.201341:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1018 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788568717.202202:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788568717.202222:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1011 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568717.202230:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1011 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568717.202237:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1011 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568717.202243:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429dea00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568717.202258:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1011 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568717.202266:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1011 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568717.202277:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae2430ad700) 00010000:00010000:3.0:1788568717.202280:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788568717.202283:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1011 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568717.202290:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1011 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788568717.202306:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd0a8467 reply state 00000000ca269695 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1018 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568717.202315:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788568717.202424:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+10:10279:x1875449958394112:12345-192.168.206.4@tcp:36:lfs.0 Request processed in 1443us (1935us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788568717.202432:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 37 00010000:00010000:2.0:1788568717.208096:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1018 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.208114:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1018 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.208133:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1018 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.208138:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429df200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568717.208143:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1018 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.208150:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1018 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.208167:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ae2430ad500) 00010000:00010000:2.0:1788568717.208171:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788568717.208175:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1018 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.208181:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1018 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568717.287922:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568717.288030:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958394240 00000100:00100000:0.0:1788568717.288060:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958394240 00000100:00100000:1.0:1788568717.288243:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 38 00000100:00100000:1.0:1788568717.288271:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+9:10287:x1875449958394240:12345-192.168.206.4@tcp:101:lctl.0 00010000:00010000:1.0:1788568717.288302:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568717.288333:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a101f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beaee expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568717.288421:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a1026 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568717.288438:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a1026 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568717.288452:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a1026 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568717.288524:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788568717.288529:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788568717.288578:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a1026 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568717.288608:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a101f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beaee expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568717.288630:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a1026 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beaee expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568717.288640:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae25820ca00) 00010000:00010000:1.0:1788568717.288644:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788568717.288649:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2dc00, rc 0) 00000100:00100000:1.0:1788568717.288759:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+10:10287:x1875449958394240:12345-192.168.206.4@tcp:101:lctl.0 Request processed in 491us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568717.288766:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 38 00000100:00100000:3.0:1788568717.336573:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568717.336674:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958394368 00000100:00100000:2.0:1788568717.336701:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958394368 00000100:00100000:2.0:1788568717.336773:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 39 00000100:00100000:2.0:1788568717.336785:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae1419bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+10:10293:x1875449958394368:12345-192.168.206.4@tcp:101:bash.0 00010000:00010000:2.0:1788568717.336812:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568717.336840:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a102d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beaf5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.336922:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1034 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.336975:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1034 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.336989:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1034 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.337008:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a103b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.337016:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a103b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.337022:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a103b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568717.337368:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a1042 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568717.337445:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a1042 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568717.337455:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a1042 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568717.337491:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788568717.337496:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788568717.337544:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a1042 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568717.337567:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1034 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568717.337575:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1034 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568717.337583:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1034 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568717.337590:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7b200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568717.337596:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1034 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568717.337606:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1034 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568717.337620:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae25820ca00) 00010000:00010000:1.0:1788568717.337623:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568717.337628:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1034 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568717.337635:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1034 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568717.337652:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a103b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568717.337659:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a103b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568717.337665:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a103b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568717.337788:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7b600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568717.337792:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a103b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568717.337799:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a103b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568717.337808:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ae255fb9b00) 00010000:00010000:1.0:1788568717.337810:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568717.337813:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a103b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568717.337819:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a103b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568717.337858:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a102d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beaf5 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568717.337869:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a1042 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beaf5 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568717.337875:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ae25820c700) 00010000:00010000:1.0:1788568717.337877:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788568717.337878:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2c800, rc 0) 00000100:00100000:1.0:1788568717.338054:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae1419bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+11:10293:x1875449958394368:12345-192.168.206.4@tcp:101:bash.0 Request processed in 1268us (1493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568717.338066:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 39 00000100:00100000:2.0:1788568717.344772:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568717.345260:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958394624 00000100:00100000:0.0:1788568717.345275:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958394624 00000100:00100000:0.0:1788568717.345350:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 40 00000100:00100000:0.0:1788568717.345363:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+11:10293:x1875449958394624:12345-192.168.206.4@tcp:101:bash.0 00010000:00010000:0.0:1788568717.345390:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568717.345418:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a1049 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beafc expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.345575:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1050 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.345592:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1050 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.345605:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1050 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.347155:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1057 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.347178:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1057 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.347191:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1057 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788568717.347822:0:6714:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1788568717.348037:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a105e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.348049:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a105e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.348058:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a105e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.348100:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1050 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.349643:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1050 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.349652:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1050 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.349657:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaa400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568717.349661:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1050 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.349690:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1050 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.349706:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ae25820c700) 00010000:00010000:0.0:1788568717.349709:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788568717.349714:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1050 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.349721:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1050 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788568717.349739:0:6714:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004c3ecfc8 reply state 00000000c8b5d150 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1057 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568717.349748:0:6714:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788568717.353693:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a1049 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beafc expref: 14 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.353724:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a105e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beafc expref: 13 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.353751:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae24515a000) 00010000:00010000:2.0:1788568717.353755:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788568717.353758:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae27feaa200, rc 0) 00000100:00100000:2.0:1788568717.354619:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+14:10293:x1875449958394624:12345-192.168.206.4@tcp:101:bash.0 Request processed in 9252us (9855us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788568717.354630:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 40 00010000:00010000:0.0:1788568717.357559:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1057 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.357580:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1057 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.357588:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1057 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.357595:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaa800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568717.357601:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1057 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.357609:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1057 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.357647:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ae24515ad00) 00010000:00010000:0.0:1788568717.357650:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788568717.357656:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1057 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.357662:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1057 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568717.359622:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568717.359763:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958394752 00000100:00100000:0.0:1788568717.359773:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958394752 00000100:00100000:0.0:1788568717.359821:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 20 00000100:00100000:0.0:1788568717.359829:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1875449958394752:12345-192.168.206.4@tcp:8:bash.0 00010000:00080000:0.0:1788568717.359860:0:6690:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 27f83c0c-e36b-48ce-9485-80051fd252dc@192.168.206.4@tcp t0 exp 0000000000000000 cur 351 last 0 00000020:00000080:0.0:1788568717.359891:0:6690:0:(genops.c:1385:class_connect()) connect: client 27f83c0c-e36b-48ce-9485-80051fd252dc, cookie 0x41e82f464b6a106c 00002000:00100000:0.0:1788568717.359903:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 27f83c0c-e36b-48ce-9485-80051fd252dc/ffff9ae248e1c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788568717.359942:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788568717.360160:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788568717.360188:0:6690:0:(import.c:65:import_set_state_nolock()) ffff9ae248e1c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788568717.360272:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2360:x1875449958394752:12345-192.168.206.4@tcp:8:bash.0 Request processed in 441us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568717.360281:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 20 00000100:00100000:2.0:1788568717.366272:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568717.366384:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958394880 00000100:00100000:3.0:1788568717.366394:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958394880 00000100:00100000:3.0:1788568717.366540:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 21 00000100:00100000:3.0:1788568717.366566:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277d95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+6:0:x1875449958394880:12345-192.168.206.4@tcp:101:bash.0 00010000:00010000:3.0:1788568717.366584:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568717.366606:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016a7f031/0x41e82f464b6a1073 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beb03 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788568717.366632:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788568717.366649:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=351s v=(0 0) 00010000:00010000:3.0:1788568717.366653:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788568717.366675:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016a7f031/0x41e82f464b6a1073 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb03 expref: 7 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568717.366695:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000016a7f031/0x41e82f464b6a1073 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb03 expref: 7 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568717.366707:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429dea00, rc 0) 00000100:00100000:3.0:1788568717.366763:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277d95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+7:0:x1875449958394880:12345-192.168.206.4@tcp:101:bash.0 Request processed in 213us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568717.366769:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 21 00000100:00080000:0.0:1788568717.367364:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788568717.378341:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568717.379805:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958395008 00000100:00100000:0.0:1788568717.379823:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958395008 00000100:00100000:1.0:1788568717.380170:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 22 00000100:00100000:1.0:1788568717.380183:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+7:10293:x1875449958395008:12345-192.168.206.4@tcp:101:bash.0 00010000:00010000:1.0:1788568717.380206:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568717.380233:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008620b04f/0x41e82f464b6a107a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beb0a expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568717.380284:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000016a7f031/0x41e82f464b6a1073 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb03 expref: 8 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568717.380295:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788568717.380300:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788568717.380307:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008620b04f/0x41e82f464b6a107a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb0a expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568717.380354:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000016a7f031/0x41e82f464b6a1073 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb03 expref: 8 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568717.380370:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000016a7f031/0x41e82f464b6a1073 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb03 expref: 8 pid: 6688 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568717.380387:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244b34700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6690:1875449976256896:192.168.206.4@tcp:104: 00000100:00100000:1.0:1788568717.380645:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae28216c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788568717.391359:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568717.391749:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958395136 00000100:00100000:0.0:1788568717.391762:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958395136 00010000:00010000:0.0:1788568717.391814:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000016a7f031/0x41e82f464b6a1073 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb03 expref: 9 pid: 6688 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568717.391895:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 35 00000100:00100000:0.0:1788568717.391907:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+9:2363:x1875449958395136:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788568717.391956:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568717.391986:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000016a7f031/0x41e82f464b6a1073 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb03 expref: 9 pid: 6688 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.392004:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000016a7f031/0x41e82f464b6a1073 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb03 expref: 9 pid: 6688 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.392339:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788568717.392345:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788568717.392356:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008620b04f/0x41e82f464b6a107a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb0a expref: 9 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.392370:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008620b04f/0x41e82f464b6a107a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb0a expref: 9 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.392423:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008620b04f/0x41e82f464b6a107a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb0a expref: 9 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568717.393359:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016a7f031/0x41e82f464b6a1073 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb03 expref: 9 pid: 6688 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568717.393387:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244b34700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6690:1875449976256896:192.168.206.4@tcp:104: 00010000:00010000:3.0:1788568717.393426:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008620b04f/0x41e82f464b6a107a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb0a expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568717.393527:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2d600, rc 0) 00000100:00100000:3.0:1788568717.393831:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+8:10293:x1875449958395008:12345-192.168.206.4@tcp:101:bash.0 Request processed in 13649us (15502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568717.393841:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 22 00000100:00100000:0.0:1788568717.394771:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739ed180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5827:1875449976257024:192.168.206.4@tcp:105: 00000100:00100000:0.0:1788568717.396263:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27bcfb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788568717.404868:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739ed180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5827:1875449976257024:192.168.206.4@tcp:105: 00010000:00010000:0.0:1788568717.404968:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788568717.405156:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+7:2363:x1875449958395136:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 13250us (13810us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568717.405169:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 35 00000100:00100000:2.0:1788568717.417816:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568717.420476:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958395392 00000100:00100000:1.0:1788568717.420498:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958395392 00000100:00100000:0.0:1788568717.420887:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 6 00000100:00100000:0.0:1788568717.420903:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277d94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+13:10293:x1875449958395392:12345-192.168.206.4@tcp:35:bash.0 00000100:00100000:0.0:1788568717.421445:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277d94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+14:10293:x1875449958395392:12345-192.168.206.4@tcp:35:bash.0 Request processed in 544us (3641us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788568717.421456:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 6 00010000:00010000:2.0:1788568717.495260:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568717.531397:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568717.531654:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958395648 00000100:00100000:3.0:1788568717.531668:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958395648 00000100:00100000:3.0:1788568717.531747:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 41 00000100:00100000:3.0:1788568717.531759:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+14:10303:x1875449958395648:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:3.0:1788568717.531789:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568717.531816:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1081 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beb11 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788568717.531965:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788568717.532132:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1081 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb11 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568717.532149:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae25820ca00) 00010000:00010000:3.0:1788568717.532153:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788568717.532159:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1081 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb11 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568717.532177:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429dea00, rc 0) 00000100:00100000:3.0:1788568717.532266:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+15:10303:x1875449958395648:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 509us (884us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1788568717.532274:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 41 00000100:00100000:1.0:1788568717.545762:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568717.546285:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958395904 00000100:00100000:3.0:1788568717.546299:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958395904 00000100:00100000:3.0:1788568717.546382:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 7 00000100:00100000:3.0:1788568717.546395:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+15:10303:x1875449958395904:12345-192.168.206.4@tcp:35:lfs.0 00000100:00100000:3.0:1788568717.546725:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+16:10303:x1875449958395904:12345-192.168.206.4@tcp:35:lfs.0 Request processed in 332us (976us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788568717.546734:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 7 00000100:00100000:2.0:1788568717.665058:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568717.665233:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958396032 00000100:00100000:1.0:1788568717.665256:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958396032 00000100:00100000:1.0:1788568717.665335:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 42 00000100:00100000:1.0:1788568717.665348:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+16:10309:x1875449958396032:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:1.0:1788568717.665380:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568717.665407:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a108f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beb18 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568717.665499:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1096 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568717.665517:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1096 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568717.665533:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1096 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568717.665581:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788568717.665586:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788568717.665613:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1096 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568717.665648:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a108f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb18 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568717.665683:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1096 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb18 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568717.665694:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ae25820c700) 00010000:00010000:1.0:1788568717.665707:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788568717.665712:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2d200, rc 0) 00000100:00100000:1.0:1788568717.665796:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+17:10309:x1875449958396032:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 450us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568717.665804:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 42 00000100:00100000:1.0:1788568717.673443:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568717.673566:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958396288 00000100:00100000:3.0:1788568717.673581:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958396288 00000100:00100000:3.0:1788568717.673735:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 43 00000100:00100000:3.0:1788568717.673751:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+17:10309:x1875449958396288:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:3.0:1788568717.673778:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568717.673805:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a109d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beb1f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.676642:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a10a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.676675:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a10a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.676819:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a10a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788568717.676848:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788568717.677286:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a109d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb1f expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.677313:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a10a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb1f expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.677388:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae24515a000) 00010000:00010000:2.0:1788568717.677410:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788568717.677416:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7a600, rc 0) 00000100:00100000:2.0:1788568717.677764:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+19:10309:x1875449958396288:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 4015us (4333us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788568717.677775:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 43 00000100:00100000:3.0:1788568717.682738:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568717.682921:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958396544 00000100:00100000:1.0:1788568717.682958:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958396544 00000100:00100000:3.0:1788568717.683469:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568717.683595:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 44 00000100:00100000:1.0:1788568717.683608:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae1419bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+19:10309:x1875449958396544:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:1.0:1788568717.683642:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568717.683681:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a10b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beb26 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568717.683717:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958396672 00000100:00100000:0.0:1788568717.683724:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958396672 00000100:00100000:0.0:1788568717.683770:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 2 00000100:00100000:0.0:1788568717.683778:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae1419bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+21:2361:x1875449958396672:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788568717.683788:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788568717.683805:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a10b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.683811:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a10a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb1f expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568717.683822:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a10b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568717.683833:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a10b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568717.684381:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788568717.685886:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae24515a000) 00010000:00010000:1.0:1788568717.685979:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a10b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb26 expref: 22 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568717.686009:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a10b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb26 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568717.686047:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae24515a000) 00010000:00010000:1.0:1788568717.686051:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788568717.686053:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2c000, rc 0) 00000100:00100000:1.0:1788568717.686148:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae1419bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+21:10309:x1875449958396544:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 2540us (3421us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788568717.686159:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 44 00010000:00010000:0.0:1788568717.687446:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788568717.687577:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae1419bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+20:2361:x1875449958396672:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 3792us (4103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568717.687592:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 2 00000100:00100000:3.0:1788568717.694201:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568717.694596:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958396800 00000100:00100000:2.0:1788568717.694612:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958396800 00000100:00100000:2.0:1788568717.695030:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 23 00000100:00100000:2.0:1788568717.695044:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2530f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+7:2364:x1875449958396800:12345-192.168.206.4@tcp:1:lfs.0 00010000:00010000:2.0:1788568717.695110:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c5bfb73/0x41e82f464b6a10c7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.695135:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008620b04f/0x41e82f464b6a107a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb0a expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.695145:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788568717.695150:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788568717.695155:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c5bfb73/0x41e82f464b6a10c7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.695214:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008620b04f/0x41e82f464b6a107a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb0a expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.695232:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008620b04f/0x41e82f464b6a107a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb0a expref: 7 pid: 6690 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568717.695258:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b680380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6688:1875449976257152:192.168.206.4@tcp:104: 00000100:00100000:2.0:1788568717.695399:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27fd4d840 going to sleep for 11 seconds 00000100:00100000:2.0:1788568717.698987:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b680380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6688:1875449976257152:192.168.206.4@tcp:104: 00010000:00010000:2.0:1788568717.699041:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003c5bfb73/0x41e82f464b6a10c7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568717.704479:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568717.704738:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958396928 00000100:00100000:0.0:1788568717.704749:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958396928 00002000:00100000:0.0:1788568717.704809:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9ae2530f4380 x1875449958396928/t0(0) o4->27f83c0c-e36b-48ce-9485-80051fd252dc@192.168.206.4@tcp:153/0 lens 504/0 e 0 to 0 dl 1788568728 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788568717.704857:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae2530f4380 with x1875449958396928 ext(0->12) 00010000:00010000:0.0:1788568717.704870:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008620b04f/0x41e82f464b6a107a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb0a expref: 8 pid: 6690 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.704890:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008620b04f/0x41e82f464b6a107a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb0a expref: 8 pid: 6690 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788568717.704899:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ae2530f4380 00000100:00100000:0.0:1788568717.704982:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 0 00000100:00100000:0.0:1788568717.704992:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2530f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+8:2363:x1875449958396928:12345-192.168.206.4@tcp:4:lfs.0 00000001:00100000:2.0:1788568717.812557:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 27f83c0c-e36b-48ce-9485-80051fd252dc 00000100:00100000:0.0:1788568717.815302:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976257408:0@lo:400:kworker.0 00000100:00100000:0.0:1788568717.815397:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568717.815480:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976257920:0@lo:400:kworker.0 00000100:00100000:0.0:1788568717.815511:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568717.815551:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788568717.815557:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875449976257536:0@lo:400:kworker.0 00000100:00100000:0.0:1788568717.815580:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568717.815622:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976257920 00000100:00100000:0.0:1788568717.815632:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976257920 00000100:00100000:0.0:1788568717.815702:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788568717.815713:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976257920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568717.815786:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976257920:12345-0@lo:400:kworker.0 Request processed in 74us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568717.815794:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788568717.816078:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976257920:0@lo:400:kworker.0 00000100:00100000:2.0:1788568717.816554:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976257664:0@lo:400:kworker.0 00000100:00100000:2.0:1788568717.816604:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568717.816649:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788568717.816656:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:925db6b8-84bc-418c-b37a-40345c1020be:3308:1875449976257280:0@lo:400:kworker.0 00000100:00100000:2.0:1788568717.816697:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568717.816724:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875449976257792:0@lo:400:kworker.0 00000100:00100000:2.0:1788568717.816750:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568717.816799:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976257408 00000100:00100000:2.0:1788568717.816805:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976257408 00000100:00100000:2.0:1788568717.816846:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976257536 00000100:00100000:2.0:1788568717.816850:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976257536 00000100:00100000:2.0:1788568717.817160:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976257792 00000100:00100000:2.0:1788568717.817165:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976257792 00000100:00100000:2.0:1788568717.817188:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788568717.817197:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976257408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568717.817270:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976257408:12345-0@lo:400:kworker.0 Request processed in 74us (1873us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568717.817278:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788568717.817296:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788568717.817303:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875449976257536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568717.817351:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875449976257536:12345-0@lo:400:kworker.0 Request processed in 48us (1769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568717.817357:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788568717.817371:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788568717.817377:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875449976257792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568717.817410:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875449976257792:12345-0@lo:400:kworker.0 Request processed in 33us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568717.817416:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788568717.817563:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875449976257536:0@lo:400:kworker.0 00000100:00100000:2.0:1788568717.817576:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976257408:0@lo:400:kworker.0 00000100:00100000:2.0:1788568717.817627:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875449976257792:0@lo:400:kworker.0 00000100:00100000:0.0:1788568717.817715:0:8111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976257664 00000100:00100000:0.0:1788568717.817720:0:8111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976257664 00000100:00100000:0.0:1788568717.817771:0:8111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788568717.817779:0:8111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976257664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568717.817821:0:8111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976257664:12345-0@lo:400:kworker.0 Request processed in 44us (1216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568717.817829:0:8111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788568717.818618:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976257664:0@lo:400:kworker.0 00000100:00080000:1.0:1788568717.819114:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788568717.819123:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788568717.819127:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788568717.819147:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976257280 00000100:00100000:1.0:1788568717.819155:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976257280 00000100:00100000:1.0:1788568717.819221:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788568717.819232:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+19:3308:x1875449976257280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568717.819346:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+19:3308:x1875449976257280:12345-0@lo:400:kworker.0 Request processed in 116us (2647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568717.819354:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788568717.819747:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:925db6b8-84bc-418c-b37a-40345c1020be:3308:1875449976257280:0@lo:400:kworker.0 00000001:00080000:2.0:1788568717.948115:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:3.0:1788568717.948400:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2530f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+7:2363:x1875449958396928:12345-192.168.206.4@tcp:4:lfs.0 Request processed in 243399us (243923us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788568717.948424:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 0 00002000:00100000:3.0:1788568717.948441:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9ae2530f4380 x1875449958396928/t4294967299(0) o4->27f83c0c-e36b-48ce-9485-80051fd252dc@192.168.206.4@tcp:153/0 lens 504/448 e 0 to 0 dl 1788568728 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788568717.948452:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae2530f4380 with x1875449958396928 ext(0->12) 00010000:00010000:3.0:1788568717.948466:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008620b04f/0x41e82f464b6a107a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb0a expref: 7 pid: 6690 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568717.948873:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008620b04f/0x41e82f464b6a107a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb0a expref: 7 pid: 6690 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788568717.948883:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ae2530f4380 00000100:00100000:3.0:1788568717.956115:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568717.957051:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958397056 00000100:00100000:2.0:1788568717.957065:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958397056 00010000:00010000:2.0:1788568717.957123:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008620b04f/0x41e82f464b6a107a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb0a expref: 7 pid: 6690 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568717.957299:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 36 00000100:00100000:2.0:1788568717.957311:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2530f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+7:2363:x1875449958397056:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788568717.957332:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788568717.957357:0:5829:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788568717.957360:0:5829:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788568716 00002000:00010000:2.0:1788568717.957363:0:5829:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788568716 00002000:00010000:2.0:1788568717.957380:0:5829:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788568716 00002000:00010000:2.0:1788568717.957382:0:5829:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1788568717.957389:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008620b04f/0x41e82f464b6a107a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb0a expref: 7 pid: 6690 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.957404:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008620b04f/0x41e82f464b6a107a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb0a expref: 7 pid: 6690 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.957436:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008620b04f/0x41e82f464b6a107a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb0a expref: 7 pid: 6690 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.957455:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788568717.957460:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788568717.957467:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c5bfb73/0x41e82f464b6a10c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.957477:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c5bfb73/0x41e82f464b6a10c7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.957519:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568717.957600:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2530f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2363:x1875449958397056:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 291us (1626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568717.957608:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 36 00010000:00010000:3.0:1788568717.963312:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003c5bfb73/0x41e82f464b6a10c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568717.963339:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c5bfb73/0x41e82f464b6a10c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568717.963390:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c5bfb73/0x41e82f464b6a10c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568717.963399:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c5bfb73/0x41e82f464b6a10c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568717.963409:0:6688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c5bfb73/0x41e82f464b6a10c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568717.963415:0:6688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7a200 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788568717.963421:0:6688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c5bfb73/0x41e82f464b6a10c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568717.963431:0:6688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c5bfb73/0x41e82f464b6a10c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568717.963475:0:6688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c5bfb73/0x41e82f464b6a10c7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568717.963484:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c5bfb73/0x41e82f464b6a10c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568717.963627:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2530f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2364:x1875449958396800:12345-192.168.206.4@tcp:1:lfs.0 Request processed in 268579us (269435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568717.963640:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 23 00000100:00100000:3.0:1788568717.967628:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568717.970023:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958397312 00000100:00100000:0.0:1788568717.970043:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958397312 00000100:00100000:0.0:1788568717.970157:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 8 00000100:00100000:0.0:1788568717.970171:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2530f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+20:10309:x1875449958397312:12345-192.168.206.4@tcp:35:lfs.0 00000004:00010000:0.0:1788568717.970283:0:5845:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a10b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb26 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788568717.970658:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1788568717.970719:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1788568717.974566:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1788568717.974699:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a10ce lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.974726:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a105e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beafc expref: 24 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.974738:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a10ce lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.975121:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a105e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beafc expref: 24 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568717.975144:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a105e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beafc expref: 24 pid: 6714 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568717.975162:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739ed180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5845:1875449976258048:192.168.206.4@tcp:104: 00000100:00100000:0.0:1788568717.975437:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27bcfb480 going to sleep for 11 seconds 00000100:00100000:0.0:1788568717.978603:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739ed180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5845:1875449976258048:192.168.206.4@tcp:104: 00010000:00010000:0.0:1788568717.978644:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a10ce lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568717.979648:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568717.979981:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958397440 00000100:00100000:2.0:1788568717.979993:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958397440 00010000:00010000:2.0:1788568717.980054:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a105e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beafc expref: 25 pid: 6714 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568717.980138:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 37 00000100:00100000:2.0:1788568717.980151:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2530f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+25:2364:x1875449958397440:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788568717.980171:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568717.980179:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a105e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beafc expref: 25 pid: 6714 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.980195:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a105e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beafc expref: 25 pid: 6714 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.980228:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a105e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beafc expref: 25 pid: 6714 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.980256:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae24515a000) 00010000:00010000:2.0:1788568717.980263:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a10ce lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.980274:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a10ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.980284:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a10ce lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.980314:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568717.980386:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2530f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+24:2364:x1875449958397440:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 237us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568717.980394:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 37 00010000:00010000:3.0:1788568717.981043:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a10ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568717.981056:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a10ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788568717.981256:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1788568717.981504:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1788568717.982175:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2530f7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1875449976258176:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788568717.982478:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568717.982533:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae241254b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788568717.982664:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976258176 00000100:00100000:3.0:1788568717.982673:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976258176 00000100:00100000:3.0:1788568717.982736:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788568717.982747:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1875449976258176:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788568717.982862:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1875449976258176:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 116us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568717.982880:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788568717.983153:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2530f7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1875449976258176:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788568717.984061:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1788568717.984176:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b682680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1875449976258304:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788568717.984257:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568717.984300:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae26f6a30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788568717.984861:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976258304 00000100:00100000:3.0:1788568717.984872:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976258304 00000100:00100000:3.0:1788568717.985004:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788568717.985016:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1875449976258304:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788568717.985712:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5845:x1875449976258304:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 694us (1450us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788568717.985722:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788568717.985852:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b682680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1875449976258304:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788568717.985957:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1788568717.986029:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a10ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.986042:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a10ce lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.986050:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a10ce lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.986056:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaa800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568717.986062:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a10ce lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.986071:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a10ce lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.986090:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae24515a000) 00010000:00010000:2.0:1788568717.986093:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788568717.986099:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a10ce lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.986106:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a10ce lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788568717.987502:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788568717.988024:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788568717.988040:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 352396112678ns, next at 353396110116ns, rc = 0 00000001:00080000:2.0:1788568717.988051:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1788568717.988118:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae24515a000) 00010000:00010000:2.0:1788568717.988123:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788568717.988136:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a10b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb26 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568717.988487:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2530f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+27:10309:x1875449958397312:12345-192.168.206.4@tcp:35:lfs.0 Request processed in 18316us (20869us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1788568717.988498:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 8 00000020:00080000:2.0:1788568717.988505:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788568717.993164:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568717.993331:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958397568 00000100:00100000:2.0:1788568717.993344:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958397568 00000100:00100000:2.0:1788568717.993472:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 45 00000100:00100000:2.0:1788568717.993485:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+27:10309:x1875449958397568:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:2.0:1788568717.993521:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568717.993557:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a10d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beb2d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.993649:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a10d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb2d expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.993669:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a10d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb2d expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568717.993720:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae255fb9500) 00010000:00010000:2.0:1788568717.993724:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788568717.993728:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7ae00, rc 0) 00000100:00100000:2.0:1788568717.993816:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+28:10309:x1875449958397568:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 332us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568717.993822:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 45 00000100:00100000:3.0:1788568717.996866:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568717.996985:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958397824 00000100:00100000:1.0:1788568717.996998:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958397824 00000100:00100000:1.0:1788568717.997069:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 9 00000100:00100000:1.0:1788568717.997081:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2492b3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+28:10309:x1875449958397824:12345-192.168.206.4@tcp:35:lfs.0 00000100:00100000:1.0:1788568717.997398:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2492b3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+29:10309:x1875449958397824:12345-192.168.206.4@tcp:35:lfs.0 Request processed in 318us (544us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1788568717.997406:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 9 00000100:00100000:1.0:1788568718.071830:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568718.071987:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958398080 00000100:00100000:2.0:1788568718.072002:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958398080 00000100:00100000:2.0:1788568718.072092:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 46 00000100:00100000:2.0:1788568718.072105:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+29:10320:x1875449958398080:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:2.0:1788568718.072140:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568718.072169:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a10dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beb34 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788568718.072305:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788568718.072493:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a10dc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb34 expref: 31 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568718.072511:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae25820ca00) 00010000:00010000:2.0:1788568718.072514:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788568718.072521:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a10dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb34 expref: 31 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568718.072539:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7a600, rc 0) 00000100:00100000:2.0:1788568718.072631:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+30:10320:x1875449958398080:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 529us (818us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1788568718.072652:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 46 00000100:00100000:2.0:1788568718.076015:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568718.076092:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958398208 00000100:00100000:0.0:1788568718.076107:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958398208 00000100:00100000:0.0:1788568718.076230:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 47 00000100:00100000:0.0:1788568718.076255:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+30:10320:x1875449958398208:12345-192.168.206.4@tcp:34:lfs.0 00010000:00010000:0.0:1788568718.076622:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a10ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.076649:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a10ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.076666:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a10ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.076701:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a10f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.076736:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a10f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.076744:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a10f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.076861:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a10f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.076870:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a10f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.076877:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a10f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788568718.076954:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a10f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.076968:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a10ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.076976:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a10ea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.076984:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a10ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.076990:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaa400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568718.076996:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a10ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.077004:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a10ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.077023:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ae25820c700) 00010000:00010000:0.0:1788568718.077027:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788568718.077032:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a10ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.077040:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a10ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.077053:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a10f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.077059:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a10f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.077065:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a10f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.077071:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feab000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568718.077074:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a10f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.077080:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a10f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.077086:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ae24515a700) 00010000:00010000:0.0:1788568718.077089:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788568718.077091:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a10f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.077097:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a10f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.077124:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a10f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.077131:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a10f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.077136:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a10f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.077142:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaa800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568718.077145:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a10f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.077152:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a10f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.080174:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae255fb9500) 00010000:00010000:0.0:1788568718.080189:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788568718.080212:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a10f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.080226:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a10f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568718.080374:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+30:10320:x1875449958398208:12345-192.168.206.4@tcp:34:lfs.0 Request processed in 4127us (4368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568718.080388:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 47 00000100:00100000:3.0:1788568718.083167:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568718.083759:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958398464 00000100:00100000:2.0:1788568718.083775:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958398464 00000100:00100000:2.0:1788568718.083856:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 10 00000100:00100000:2.0:1788568718.083869:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2530f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+30:10320:x1875449958398464:12345-192.168.206.4@tcp:35:lfs.0 00000100:00100000:2.0:1788568718.088114:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2530f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+31:10320:x1875449958398464:12345-192.168.206.4@tcp:35:lfs.0 Request processed in 4229us (4943us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1788568718.088134:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 10 00000100:00100000:1.0:1788568718.138531:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568718.142043:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958398720 00000100:00100000:2.0:1788568718.142066:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958398720 00000100:00100000:3.0:1788568718.142635:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 48 00000100:00100000:3.0:1788568718.142649:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+31:10323:x1875449958398720:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:3.0:1788568718.142682:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568718.142714:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a10ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beb3b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568718.142837:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a1106 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568718.142856:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a1106 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568718.142874:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a1106 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568718.142893:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a110d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568718.142977:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a110d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568718.142986:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a110d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568718.143159:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1114 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568718.143170:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1114 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568718.143178:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1114 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788568718.143190:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788568718.143442:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a1106 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568718.143451:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a1106 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568718.143458:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a1106 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568718.143464:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429df400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568718.143469:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a1106 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568718.143478:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a1106 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568718.143506:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ae25820c700) 00010000:00010000:3.0:1788568718.143510:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788568718.143517:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a1106 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568718.143524:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a1106 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568718.143544:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a110d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568718.143550:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a110d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568718.143556:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a110d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568718.143563:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429dea00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568718.143566:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a110d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568718.143572:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a110d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568718.143580:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ae2430ad700) 00010000:00010000:3.0:1788568718.143582:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788568718.143584:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a110d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568718.143590:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a110d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568718.143669:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a10ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb3b expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568718.143684:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1114 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb3b expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568718.143693:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae255fb9500) 00010000:00010000:3.0:1788568718.143695:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788568718.143697:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429df200, rc 0) 00000100:00100000:3.0:1788568718.144188:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+33:10323:x1875449958398720:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 1537us (5668us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1788568718.144200:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 48 00000100:00100000:1.0:1788568718.148963:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568718.149075:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958398848 00000100:00100000:2.0:1788568718.149090:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958398848 00000100:00100000:2.0:1788568718.149172:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 49 00000100:00100000:2.0:1788568718.149186:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277d94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+33:10323:x1875449958398848:12345-192.168.206.4@tcp:54:lfs.0 00010000:00010000:2.0:1788568718.149290:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1122 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568718.149313:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1122 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568718.149328:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1122 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568718.149368:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1122 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568718.149376:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1122 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568718.149403:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1122 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568718.149410:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7b200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568718.149416:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1122 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568718.149425:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1122 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568718.149440:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae255fb9500) 00010000:00010000:2.0:1788568718.149443:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788568718.149449:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1122 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568718.149457:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1122 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568718.149563:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277d94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+33:10323:x1875449958398848:12345-192.168.206.4@tcp:54:lfs.0 Request processed in 380us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568718.149571:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 49 00000100:00100000:2.0:1788568718.153412:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568718.153630:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958399104 00000100:00100000:3.0:1788568718.153643:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958399104 00000100:00100000:3.0:1788568718.153720:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 11 00000100:00100000:3.0:1788568718.153743:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+33:10323:x1875449958399104:12345-192.168.206.4@tcp:35:lfs.0 00000100:00100000:3.0:1788568718.154112:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+34:10323:x1875449958399104:12345-192.168.206.4@tcp:35:lfs.0 Request processed in 381us (712us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1788568718.154121:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 11 00000100:00100000:2.0:1788568718.327790:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788568718.327823:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2530f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976258432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788568718.327910:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568718.328566:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976258432 00000100:00100000:3.0:1788568718.328579:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976258432 00000100:00100000:3.0:1788568718.328644:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788568718.328655:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875449976258432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788568718.328684:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1788568718.328759:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875449976258432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568718.328783:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788568718.329494:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2530f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976258432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788568718.425530:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568718.425638:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958399360 00000100:00100000:2.0:1788568718.425651:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958399360 00000100:00100000:2.0:1788568718.425720:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 50 00000100:00100000:2.0:1788568718.425739:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+34:10354:x1875449958399360:12345-192.168.206.4@tcp:101:cat.0 00010000:00010000:2.0:1788568718.425781:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568718.425811:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1129 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beb42 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568718.426015:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1130 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568718.426034:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1130 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568718.426049:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1130 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788568718.426062:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788568718.426489:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1129 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb42 expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568718.426516:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1130 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb42 expref: 36 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568718.426526:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae255fb9500) 00010000:00010000:2.0:1788568718.426530:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788568718.426535:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7b600, rc 0) 00000100:00100000:2.0:1788568718.426630:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+36:10354:x1875449958399360:12345-192.168.206.4@tcp:101:cat.0 Request processed in 899us (1112us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1788568718.426638:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 50 00000100:00100000:1.0:1788568718.436105:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568718.436180:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568718.436364:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958399616 00000100:00100000:3.0:1788568718.436377:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958399616 00000100:00100000:3.0:1788568718.436455:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 12 00000100:00100000:3.0:1788568718.436467:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+36:10354:x1875449958399616:12345-192.168.206.4@tcp:35:cat.0 00000100:00100000:2.0:1788568718.437281:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958399744 00000100:00100000:2.0:1788568718.437290:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958399744 00000100:00100000:2.0:1788568718.437351:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 3 00000100:00100000:2.0:1788568718.437369:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25319fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+38:2362:x1875449958399744:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788568718.437385:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568718.437415:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1130 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb42 expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568718.437437:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae255fb9500) 00010000:00010000:2.0:1788568718.437443:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788568718.437485:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+37:10354:x1875449958399616:12345-192.168.206.4@tcp:35:cat.0 Request processed in 1020us (1393us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1788568718.437499:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 12 00000100:00100000:2.0:1788568718.439453:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25319fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+36:2362:x1875449958399744:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 2068us (3254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568718.439482:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 3 00000100:00100000:0.0:1788568718.502566:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568718.502776:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958400000 00000100:00100000:2.0:1788568718.502789:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958400000 00000100:00100000:2.0:1788568718.502905:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 51 00000100:00100000:2.0:1788568718.502919:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+36:10360:x1875449958400000:12345-192.168.206.4@tcp:101:dd.0 00010000:00010000:2.0:1788568718.503011:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568718.503015:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788568718.503050:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1096 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb18 expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568718.503075:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ae25820c700) 00010000:00010000:2.0:1788568718.503081:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788568718.503098:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a113e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beb49 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568718.503235:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1145 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568718.503262:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1114 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb3b expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568718.503281:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1145 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568718.503325:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1114 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb3b expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568718.503341:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1114 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb3b expref: 36 pid: 5844 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568718.503357:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b680700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875449976258560:192.168.206.4@tcp:104: 00000100:00100000:2.0:1788568718.503754:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae26f6a30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788568718.508451:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568718.508577:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b680700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875449976258560:192.168.206.4@tcp:104: 00010000:00010000:2.0:1788568718.508619:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1145 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568718.508712:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958400128 00000100:00100000:0.0:1788568718.508722:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958400128 00010000:00010000:0.0:1788568718.508771:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1114 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb3b expref: 37 pid: 5844 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568718.508851:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 38 00000100:00100000:0.0:1788568718.508863:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2530f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+37:2363:x1875449958400128:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788568718.508881:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568718.508889:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1114 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb3b expref: 37 pid: 5844 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.508901:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1114 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb3b expref: 37 pid: 5844 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.508954:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1114 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb3b expref: 37 pid: 5844 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.508973:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae255fb9500) 00010000:00010000:0.0:1788568718.508978:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1145 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.508989:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1145 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.508998:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1145 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.509031:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788568718.509103:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2530f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+36:2363:x1875449958400128:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 241us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568718.509129:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 38 00010000:00010000:3.0:1788568718.509192:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1145 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568718.509208:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1145 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788568718.509232:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788568718.509465:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a113e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb49 expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568718.509481:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1145 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb49 expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568718.509490:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae255fb9500) 00010000:00010000:3.0:1788568718.509493:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788568718.509495:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7b200, rc 0) 00000100:00100000:3.0:1788568718.509527:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+36:10360:x1875449958400000:12345-192.168.206.4@tcp:101:dd.0 Request processed in 6612us (6977us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1788568718.509550:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 51 00000100:00100000:1.0:1788568718.515033:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568718.515249:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958400384 00000100:00100000:2.0:1788568718.515263:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958400384 00000100:00100000:2.0:1788568718.515336:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 52 00000100:00100000:2.0:1788568718.515347:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277973800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+36:10360:x1875449958400384:12345-192.168.206.4@tcp:36:dd.0 00010000:00010000:2.0:1788568718.515877:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a1153 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568718.515900:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a1153 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568718.515914:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a1153 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788568718.516042:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1788568718.516073:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000005a0bb2c reply state 000000000375d12c transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a1153 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568718.516083:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788568718.516378:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277973800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+39:10360:x1875449958400384:12345-192.168.206.4@tcp:36:dd.0 Request processed in 1029us (1358us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788568718.516387:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 52 00000020:00080000:2.0:1788568718.516393:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788568718.521834:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568718.524149:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a1153 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.524171:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a1153 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.524180:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a1153 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.524185:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7bc00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568718.524191:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a1153 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.524199:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a1153 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.524221:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae255fb9500) 00010000:00010000:0.0:1788568718.524224:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788568718.524229:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a1153 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.524236:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a1153 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568718.843506:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976258688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788568718.843619:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568718.844149:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976258688 00000100:00100000:3.0:1788568718.844162:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976258688 00000100:00100000:3.0:1788568718.844246:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788568718.844258:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976258688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788568718.844316:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788568718.844397:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976258688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568718.844405:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788568718.844534:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976258688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788568718.910821:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568718.912100:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958400512 00000100:00100000:0.0:1788568718.912119:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958400512 00000100:00100000:0.0:1788568718.912203:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 53 00000100:00100000:0.0:1788568718.912233:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+38:10374:x1875449958400512:12345-192.168.206.4@tcp:101:stat.0 00010000:00010000:0.0:1788568718.912277:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568718.912304:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a115a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beb50 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.912397:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1161 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.912415:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1161 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.912509:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1161 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.912529:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a1168 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.912536:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a1168 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.912544:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a1168 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.912651:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabc00/0x41e82f464b6a116f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.912663:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1145 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb49 expref: 39 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.912672:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabc00/0x41e82f464b6a116f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.912800:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1145 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb49 expref: 39 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.912818:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1145 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb49 expref: 39 pid: 5843 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568718.912834:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1875449976258816:192.168.206.4@tcp:104: 00000100:00100000:0.0:1788568718.913014:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27bcfb480 going to sleep for 11 seconds 00000100:00100000:1.0:1788568718.923571:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568718.923655:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958400768 00000100:00100000:2.0:1788568718.923676:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958400768 00000100:00100000:2.0:1788568718.923749:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 13 00000100:00100000:2.0:1788568718.923760:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+40:5599:x1875449958400768:12345-192.168.206.4@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788568718.925036:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1875449976258816:192.168.206.4@tcp:104: 00010000:00010000:0.0:1788568718.925072:0:6714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabc00/0x41e82f464b6a116f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568718.926778:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+41:5599:x1875449958400768:12345-192.168.206.4@tcp:35:ldlm_bl.0 Request processed in 1905us (2107us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1788568718.926798:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 13 00000100:00100000:3.0:1788568718.931465:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568718.932234:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958400896 00000100:00100000:0.0:1788568718.932260:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958400896 00010000:00010000:0.0:1788568718.932318:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1145 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb49 expref: 41 pid: 5843 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568718.932373:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 39 00000100:00100000:0.0:1788568718.932386:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2530f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+41:2363:x1875449958400896:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788568718.932404:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568718.932412:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1145 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb49 expref: 41 pid: 5843 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.932427:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1145 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb49 expref: 41 pid: 5843 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.932477:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1145 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb49 expref: 41 pid: 5843 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.932497:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae255fb9500) 00010000:00010000:0.0:1788568718.932503:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabc00/0x41e82f464b6a116f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.932514:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabc00/0x41e82f464b6a116f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.932522:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabc00/0x41e82f464b6a116f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568718.932565:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788568718.932638:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2530f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+40:2363:x1875449958400896:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 255us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568718.932647:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 39 00010000:00010000:1.0:1788568718.932820:0:6714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabc00/0x41e82f464b6a116f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568718.932830:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabc00/0x41e82f464b6a116f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568718.932885:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788568718.932889:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788568718.932980:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabc00/0x41e82f464b6a116f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568718.932996:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabc00/0x41e82f464b6a116f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568718.933007:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1161 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568718.933015:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1161 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568718.933023:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1161 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568718.933029:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaa200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568718.933040:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1161 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568718.933050:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1161 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568718.933060:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ae25820c700) 00010000:00010000:1.0:1788568718.933063:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568718.933067:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1161 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568718.933075:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1161 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568718.933086:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a1168 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568718.933091:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a1168 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568718.933097:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a1168 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568718.933102:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feabe00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568718.933105:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a1168 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568718.933110:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a1168 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568718.933117:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ae24515a700) 00010000:00010000:1.0:1788568718.933119:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568718.933135:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a1168 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568718.933141:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a1168 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568718.933183:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a115a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb50 expref: 40 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568718.933203:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabc00/0x41e82f464b6a116f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb50 expref: 39 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568718.933211:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae255fb9500) 00010000:00010000:1.0:1788568718.933214:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788568718.933216:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae27feabc00, rc 0) 00000100:00100000:1.0:1788568718.933257:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+39:10374:x1875449958400512:12345-192.168.206.4@tcp:101:stat.0 Request processed in 21029us (22452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568718.933265:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 53 00000100:00100000:0.0:1788568719.029206:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568719.029298:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958401152 00000100:00100000:3.0:1788568719.029311:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958401152 00000100:00100000:3.0:1788568719.029406:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 54 00000100:00100000:3.0:1788568719.029419:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+39:10380:x1875449958401152:12345-192.168.206.4@tcp:36:truncate.0 00010000:00010000:3.0:1788568719.029498:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568719.029535:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabc00/0x41e82f464b6a116f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb50 expref: 39 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568719.029561:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae255fb9500) 00010000:00010000:3.0:1788568719.029568:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788568719.029846:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a1176 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568719.029863:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a1176 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568719.029875:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a1176 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788568719.030110:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1788568719.030153:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003516cec6 reply state 00000000f3493936 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a1176 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568719.030165:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788568719.030602:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+41:10380:x1875449958401152:12345-192.168.206.4@tcp:36:truncate.0 Request processed in 1182us (1416us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1788568719.030612:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 54 00000020:00080000:3.0:1788568719.030618:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:0.0:1788568719.030633:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788568719.037380:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a1176 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568719.037403:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a1176 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568719.037412:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a1176 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568719.037417:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429df000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568719.037444:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a1176 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568719.037453:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a1176 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568719.037475:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae255fb9500) 00010000:00010000:0.0:1788568719.037479:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788568719.037484:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a1176 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568719.037491:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a1176 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568719.274694:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568719.275022:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958401280 00000100:00100000:2.0:1788568719.275036:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958401280 00000100:00100000:2.0:1788568719.275117:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 55 00000100:00100000:2.0:1788568719.275130:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+40:10394:x1875449958401280:12345-192.168.206.4@tcp:101:stat.0 00010000:00010000:2.0:1788568719.275161:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568719.275318:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a117d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beb57 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.275443:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1184 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.275461:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1184 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.275475:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1184 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.275493:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a118b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.275500:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a118b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.275506:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a118b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.275698:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1192 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.275708:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1192 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.275715:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1192 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788568719.275760:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1788568719.275770:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788568719.275799:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1192 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.275824:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1192 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.275834:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1184 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.275840:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1184 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.275846:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1184 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.275852:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7b600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568719.275856:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1184 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.275864:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1184 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.275878:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ae25820c700) 00010000:00010000:2.0:1788568719.275882:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788568719.275887:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1184 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.275894:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1184 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.275909:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a118b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.276677:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a118b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.276697:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a118b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.276702:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7a600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568719.276706:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a118b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.276715:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a118b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.276727:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ae255fb9c00) 00010000:00010000:2.0:1788568719.276730:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788568719.276734:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a118b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.276741:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a118b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.276798:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a117d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb57 expref: 42 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.276812:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1192 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb57 expref: 41 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.276820:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae255fb9500) 00010000:00010000:2.0:1788568719.276822:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788568719.276824:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7be00, rc 0) 00000100:00100000:2.0:1788568719.276952:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+41:10394:x1875449958401280:12345-192.168.206.4@tcp:101:stat.0 Request processed in 1801us (2249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568719.276972:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 55 00000100:00100000:3.0:1788568719.381407:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568719.385802:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958401536 00000100:00100000:2.0:1788568719.385824:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958401536 00000100:00100000:2.0:1788568719.385902:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 56 00000100:00100000:2.0:1788568719.385913:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2530f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+41:10404:x1875449958401536:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:2.0:1788568719.385959:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568719.385999:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a1199 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beb5e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788568719.386128:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788568719.386440:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a1199 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb5e expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.386458:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae25820ca00) 00010000:00010000:2.0:1788568719.386462:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788568719.386468:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a1199 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb5e expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.386483:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7bc00, rc 0) 00000100:00100000:2.0:1788568719.386580:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2530f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+42:10404:x1875449958401536:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 668us (5186us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1788568719.386588:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 56 00000100:00100000:0.0:1788568719.390143:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568719.390302:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958401792 00000100:00100000:1.0:1788568719.390316:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958401792 00000100:00100000:1.0:1788568719.390395:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 14 00000100:00100000:1.0:1788568719.390409:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+42:10404:x1875449958401792:12345-192.168.206.4@tcp:35:lfs.0 00000100:00100000:1.0:1788568719.391258:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+43:10404:x1875449958401792:12345-192.168.206.4@tcp:35:lfs.0 Request processed in 781us (1058us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1788568719.391272:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 14 00000001:00080000:1.0:1788568719.417513:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967320 is committed 00000001:00080000:1.0:1788568719.417545:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967326 is committed 00000001:00080000:1.0:1788568719.417560:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967336 is committed 00000004:00080000:1.0:1788568719.417603:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:1.0:1788568719.417635:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ae26f6a3780 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1788568719.417641:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ae277b2fe00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ae26f6a39c0 00000020:00080000:1.0:1788568719.417645:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ae277b2f800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ae27ff4c400 00000001:00080000:1.0:1788568719.417673:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967338 is committed 00000100:00100000:2.0:1788568719.417913:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788568719.417979:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976258944:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788568719.418068:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568719.418153:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976258944 00000100:00100000:2.0:1788568719.418172:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976258944 00000100:00100000:2.0:1788568719.418387:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788568719.418399:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1875449976258944:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788568719.418434:0:6690:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1788568719.418477:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9b648c, atime: 0x6a9b648c, ctime: 0x6a9b648c, blocks: 0xb 00010000:00010000:2.0:1788568719.418487:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abfa10a7/0x41e82f464b6a11a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.418507:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=353s v=(0 0) 00010000:00010000:2.0:1788568719.418513:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788568719.418521:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abfa10a7/0x41e82f464b6a11a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.418542:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abfa10a7/0x41e82f464b6a11a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.418555:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abfa10a7/0x41e82f464b6a11a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.418563:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abfa10a7/0x41e82f464b6a11a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.418585:0:6690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788568719.419771:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1875449976258944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1368us (1696us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788568719.419784:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1788568719.419827:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788568719.419853:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788568719.419861:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abfa10a7/0x41e82f464b6a11a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.419874:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7bc00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:2.0:1788568719.419880:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abfa10a7/0x41e82f464b6a11a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.419893:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abfa10a7/0x41e82f464b6a11a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.419916:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abfa10a7/0x41e82f464b6a11a7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788568719.420246:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1788568719.420342:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:2.0:1788568719.420484:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abfa10a7/0x41e82f464b6a11a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.420517:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568719.420519:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568719.420521:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788568719.420577:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ae27b683b80/2, rc 0, transno 4294967301 00000100:00100000:2.0:1788568719.420587:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976258944:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788568719.467860:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568719.467992:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958402048 00000100:00100000:1.0:1788568719.468006:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958402048 00000100:00100000:1.0:1788568719.468087:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 57 00000100:00100000:1.0:1788568719.468101:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+13:10410:x1875449958402048:12345-192.168.206.4@tcp:101:bash.0 00010000:00010000:1.0:1788568719.468134:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568719.468164:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a11ae lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beb65 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568719.468485:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a11b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568719.468506:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1192 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb57 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568719.468516:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a11b5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568719.468562:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1192 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb57 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568719.468578:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1192 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb57 expref: 14 pid: 5843 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568719.468620:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277970a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1875449976259072:192.168.206.4@tcp:104: 00000100:00100000:1.0:1788568719.468754:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27906c840 going to sleep for 11 seconds 00000100:00100000:0.0:1788568719.473174:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568719.473547:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277970a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1875449976259072:192.168.206.4@tcp:104: 00010000:00010000:1.0:1788568719.473583:0:6714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a11b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568719.476915:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958402176 00000100:00100000:2.0:1788568719.476956:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958402176 00010000:00010000:2.0:1788568719.477099:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1192 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb57 expref: 15 pid: 5843 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568719.477181:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 40 00000100:00100000:2.0:1788568719.477193:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+15:2364:x1875449958402176:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788568719.477212:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568719.477220:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1192 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb57 expref: 15 pid: 5843 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.477247:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1192 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb57 expref: 15 pid: 5843 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.477273:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1192 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb57 expref: 15 pid: 5843 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.477292:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae255fb9500) 00010000:00010000:2.0:1788568719.477297:0:6705:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a11b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.477307:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a11b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.477316:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a11b5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.477436:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568719.477540:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+14:2364:x1875449958402176:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 349us (4379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568719.477549:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 40 00010000:00010000:1.0:1788568719.478426:0:6714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a11b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568719.478441:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a11b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568719.478468:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788568719.479374:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a11ae lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb65 expref: 15 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.479419:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a11b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb65 expref: 14 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.479429:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae255fb9500) 00010000:00010000:2.0:1788568719.479432:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788568719.479436:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2c400, rc 0) 00000100:00100000:2.0:1788568719.479528:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+14:10410:x1875449958402048:12345-192.168.206.4@tcp:101:bash.0 Request processed in 11429us (11683us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1788568719.479538:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 57 00000100:00100000:1.0:1788568719.490012:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568719.490277:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958402432 00000100:00100000:3.0:1788568719.490292:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958402432 00000100:00100000:3.0:1788568719.490401:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 58 00000100:00100000:3.0:1788568719.490415:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277970a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+14:10410:x1875449958402432:12345-192.168.206.4@tcp:36:bash.0 00010000:00010000:3.0:1788568719.491321:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a11c3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568719.491348:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a11c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568719.491361:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a11c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788568719.491437:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:3.0:1788568719.491472:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000f20385f reply state 00000000e920c146 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a11c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568719.491621:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788568719.491838:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277970a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+17:10410:x1875449958402432:12345-192.168.206.4@tcp:36:bash.0 Request processed in 1422us (1838us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1788568719.491848:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 58 00000020:00080000:3.0:1788568719.491853:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788568719.497809:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a11c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568719.497832:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a11c3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568719.497841:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a11c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568719.497847:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429dea00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568719.497854:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a11c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568719.497864:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a11c3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568719.497912:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae255fb9500) 00010000:00010000:0.0:1788568719.497915:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788568719.497922:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a11c3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568719.497961:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a11c3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568719.503512:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568719.504868:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958402560 00000100:00100000:2.0:1788568719.504889:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958402560 00000100:00100000:2.0:1788568719.504999:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 59 00000100:00100000:2.0:1788568719.505012:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277970380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+16:10410:x1875449958402560:12345-192.168.206.4@tcp:101:bash.0 00010000:00010000:2.0:1788568719.505046:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568719.505074:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a11ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beb6c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.505198:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a11d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.505216:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a11b5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb65 expref: 17 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.505226:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a11d1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.505283:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a11b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb65 expref: 17 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.505317:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a11b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb65 expref: 17 pid: 6714 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568719.505339:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b680e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875449976259200:192.168.206.4@tcp:104: 00000100:00100000:2.0:1788568719.505462:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae277d98300 going to sleep for 11 seconds 00000100:00100000:2.0:1788568719.508650:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568719.508763:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958402688 00000100:00100000:0.0:1788568719.508775:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958402688 00010000:00010000:0.0:1788568719.508830:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a11b5 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb65 expref: 18 pid: 6714 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568719.508877:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 41 00000100:00100000:0.0:1788568719.508889:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b682a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+18:2363:x1875449958402688:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788568719.508910:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568719.508918:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a11b5 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb65 expref: 18 pid: 6714 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568719.509138:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a11b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb65 expref: 18 pid: 6714 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568719.509169:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae255fb9500) 00010000:00010000:0.0:1788568719.509175:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a11d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568719.509188:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a11d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568719.509220:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a11d1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568719.509228:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a11b5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb65 expref: 18 pid: 6714 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568719.509262:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b680e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875449976259200:192.168.206.4@tcp:104: 00010000:00010000:3.0:1788568719.509301:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a11d1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568719.510006:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788568719.510495:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b682a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+17:2363:x1875449958402688:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 1601us (1852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568719.510508:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 41 00010000:00010000:3.0:1788568719.511777:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a11d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568719.511796:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a11d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788568719.511867:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788568719.511872:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788568719.511903:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a11d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568719.511988:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a11ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb6c expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568719.512017:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a11d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb6c expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568719.512061:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae255fb9500) 00010000:00010000:3.0:1788568719.512065:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788568719.512070:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7a200, rc 0) 00000100:00100000:3.0:1788568719.512181:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277970380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+16:10410:x1875449958402560:12345-192.168.206.4@tcp:101:bash.0 Request processed in 7169us (8682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568719.512203:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 59 00000100:00100000:2.0:1788568719.525459:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568719.531090:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958402944 00000100:00100000:0.0:1788568719.531117:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958402944 00000100:00100000:1.0:1788568719.531441:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 15 00000100:00100000:1.0:1788568719.531459:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24926c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+16:10410:x1875449958402944:12345-192.168.206.4@tcp:35:bash.0 00000100:00100000:1.0:1788568719.531977:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24926c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+17:10410:x1875449958402944:12345-192.168.206.4@tcp:35:bash.0 Request processed in 521us (6531us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1788568719.531986:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 15 00010000:00010000:1.0:1788568719.543398:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568719.628074:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568719.628196:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958403200 00000100:00100000:1.0:1788568719.628210:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958403200 00000100:00100000:1.0:1788568719.628299:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 60 00000100:00100000:1.0:1788568719.628311:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+17:10420:x1875449958403200:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:1.0:1788568719.628542:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568719.628572:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ce00/0x41e82f464b6a11d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beb73 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568719.628697:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788568719.628856:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ce00/0x41e82f464b6a11d8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb73 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568719.628873:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae25820ca00) 00010000:00010000:1.0:1788568719.628876:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788568719.628883:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ce00/0x41e82f464b6a11d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb73 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568719.628903:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2ce00, rc 0) 00000100:00100000:1.0:1788568719.629030:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+18:10420:x1875449958403200:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 720us (971us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1788568719.629039:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 60 00000100:00100000:3.0:1788568719.635006:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568719.635222:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958403328 00000100:00100000:2.0:1788568719.635247:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958403328 00000100:00100000:2.0:1788568719.635335:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 61 00000100:00100000:2.0:1788568719.635481:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2530f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+18:10420:x1875449958403328:12345-192.168.206.4@tcp:34:lfs.0 00010000:00010000:2.0:1788568719.635589:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a11e6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.635612:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a11e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.635629:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a11e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.635647:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a11ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.635656:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a11ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.635663:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a11ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.636086:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a11f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.636099:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a11f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.636107:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a11f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788568719.636162:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a11f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.636177:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a11e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.636185:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a11e6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.636193:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a11e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.636201:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7aa00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568719.636206:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a11e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.636216:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a11e6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.636231:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ae25820c700) 00010000:00010000:2.0:1788568719.636247:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788568719.636254:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a11e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.636268:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a11e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.636285:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a11ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.636292:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a11ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.636298:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a11ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.636302:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7be00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568719.636306:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a11ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.636312:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a11ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.636320:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ae255fb9c00) 00010000:00010000:2.0:1788568719.636323:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788568719.636326:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a11ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.636332:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a11ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.640702:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a11f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.640729:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a11f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.640764:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a11f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.640772:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7bc00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568719.640778:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a11f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.640789:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a11f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.640814:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae255fb9500) 00010000:00010000:2.0:1788568719.640818:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788568719.640825:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a11f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.640832:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a11f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568719.642852:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2530f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+18:10420:x1875449958403328:12345-192.168.206.4@tcp:34:lfs.0 Request processed in 7490us (7844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568719.642871:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 61 00000100:00100000:2.0:1788568719.646324:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568719.650975:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958403584 00000100:00100000:0.0:1788568719.650996:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958403584 00000100:00100000:0.0:1788568719.651080:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 16 00000100:00100000:0.0:1788568719.651092:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+18:10420:x1875449958403584:12345-192.168.206.4@tcp:35:lfs.0 00000100:00100000:0.0:1788568719.651668:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+19:10420:x1875449958403584:12345-192.168.206.4@tcp:35:lfs.0 Request processed in 574us (5356us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1788568719.651678:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 16 00000100:00100000:3.0:1788568719.696080:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568719.696225:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958403840 00000100:00100000:2.0:1788568719.696249:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958403840 00000100:00100000:2.0:1788568719.696324:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 62 00000100:00100000:2.0:1788568719.696338:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2530f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+19:10423:x1875449958403840:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:2.0:1788568719.696381:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568719.696408:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a11fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beb7a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.696528:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1202 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.696546:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1202 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.696560:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1202 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.696578:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1209 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.696585:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.696592:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568719.697834:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a1210 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568719.697854:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a1210 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568719.697866:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a1210 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788568719.697880:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788568719.698022:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1202 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568719.698030:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1202 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568719.698037:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1202 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568719.698043:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7be00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568719.698048:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1202 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568719.698067:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1202 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568719.698082:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ae25820c700) 00010000:00010000:3.0:1788568719.698085:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788568719.698090:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1202 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568719.698096:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1202 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568719.698112:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568719.698118:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1209 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568719.698125:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1209 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568719.698131:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7aa00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568719.698133:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1209 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568719.698139:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1209 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568719.698146:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ae255fb9c00) 00010000:00010000:3.0:1788568719.698149:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788568719.698151:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1209 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568719.698166:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1209 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568719.698478:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a11fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb7a expref: 22 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568719.698497:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a1210 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb7a expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568719.698504:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae255fb9500) 00010000:00010000:3.0:1788568719.698507:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788568719.698510:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429df400, rc 0) 00000100:00100000:3.0:1788568719.698656:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2530f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+21:10423:x1875449958403840:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 2320us (2590us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1788568719.698665:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 62 00000100:00100000:3.0:1788568719.701403:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568719.701761:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958403968 00000100:00100000:2.0:1788568719.701775:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958403968 00000100:00100000:2.0:1788568719.701917:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 4 00000100:00100000:2.0:1788568719.701981:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2530f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+21:2364:x1875449958403968:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788568719.702003:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568719.702035:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a1210 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb7a expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.702060:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae255fb9500) 00010000:00010000:2.0:1788568719.702067:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568719.702137:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2530f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+20:2364:x1875449958403968:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 210us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568719.702165:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 4 00000100:00100000:3.0:1788568719.702665:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568719.702961:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958404096 00000100:00100000:1.0:1788568719.702970:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958404096 00000100:00100000:1.0:1788568719.703020:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 63 00000100:00100000:1.0:1788568719.703029:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2530f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+20:10423:x1875449958404096:12345-192.168.206.4@tcp:54:lfs.0 00010000:00010000:1.0:1788568719.703102:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ce00/0x41e82f464b6a121e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568719.703134:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ce00/0x41e82f464b6a121e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568719.703146:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ce00/0x41e82f464b6a121e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568719.703181:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ce00/0x41e82f464b6a121e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568719.703189:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ce00/0x41e82f464b6a121e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568719.703197:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ce00/0x41e82f464b6a121e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568719.703204:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2ce00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568719.703209:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ce00/0x41e82f464b6a121e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568719.703218:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ce00/0x41e82f464b6a121e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568719.703229:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae255fb9500) 00010000:00010000:1.0:1788568719.703242:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788568719.703248:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ce00/0x41e82f464b6a121e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568719.703256:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ce00/0x41e82f464b6a121e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568719.703324:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2530f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+20:10423:x1875449958404096:12345-192.168.206.4@tcp:54:lfs.0 Request processed in 296us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568719.703337:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 63 00000100:00100000:3.0:1788568719.705647:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568719.708516:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958404352 00000100:00100000:0.0:1788568719.708756:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958404352 00000100:00100000:1.0:1788568719.709078:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 17 00000100:00100000:1.0:1788568719.709093:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2530f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+20:10423:x1875449958404352:12345-192.168.206.4@tcp:35:lfs.0 00000100:00100000:1.0:1788568719.709434:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2530f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+21:10423:x1875449958404352:12345-192.168.206.4@tcp:35:lfs.0 Request processed in 342us (3796us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1788568719.709443:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 17 00000100:00100000:3.0:1788568719.817114:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568719.817299:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958404608 00000100:00100000:1.0:1788568719.817312:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958404608 00000100:00100000:1.0:1788568719.817395:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 64 00000100:00100000:1.0:1788568719.817418:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2530f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+21:10441:x1875449958404608:12345-192.168.206.4@tcp:101:cat.0 00010000:00010000:1.0:1788568719.817449:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568719.817489:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ce00/0x41e82f464b6a1225 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beb81 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568719.817620:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a122c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568719.817639:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a122c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568719.817652:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a122c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568719.817664:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788568719.817831:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ce00/0x41e82f464b6a1225 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb81 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568719.817878:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a122c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb81 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568719.817888:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae255fb9500) 00010000:00010000:1.0:1788568719.817891:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788568719.817896:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2da00, rc 0) 00000100:00100000:0.0:1788568719.819667:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2530f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+23:10441:x1875449958404608:12345-192.168.206.4@tcp:101:cat.0 Request processed in 2236us (2554us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1788568719.819682:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 64 00000100:00100000:2.0:1788568719.845532:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568719.845709:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958404736 00000100:00100000:1.0:1788568719.845723:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958404736 00000100:00100000:1.0:1788568719.845806:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 65 00000100:00100000:1.0:1788568719.845820:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+23:10442:x1875449958404736:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:1.0:1788568719.845861:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568719.845889:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ce00/0x41e82f464b6a123a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beb88 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568719.846595:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a1241 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568719.846615:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a1241 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568719.846629:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a1241 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568719.846672:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788568719.846676:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788568719.846695:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a1241 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568719.846755:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ce00/0x41e82f464b6a123a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb88 expref: 25 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568719.846777:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a1241 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb88 expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568719.846787:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ae25820c700) 00010000:00010000:1.0:1788568719.846790:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788568719.846793:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2d000, rc 0) 00000100:00100000:1.0:1788568719.846892:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+24:10442:x1875449958404736:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 1074us (1374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568719.846900:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 65 00000100:00100000:3.0:1788568719.851402:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568719.851553:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958405120 00000100:00100000:1.0:1788568719.851565:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958405120 00000100:00100000:1.0:1788568719.851672:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 18 00000100:00100000:1.0:1788568719.851685:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2530f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+24:10442:x1875449958405120:12345-192.168.206.4@tcp:35:lfs.0 00000100:00100000:1.0:1788568719.852161:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2530f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+25:10442:x1875449958405120:12345-192.168.206.4@tcp:35:lfs.0 Request processed in 476us (771us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1788568719.852170:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 18 00000100:00100000:0.0:1788568719.855643:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568719.855741:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958405248 00000100:00100000:2.0:1788568719.855754:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958405248 00000100:00100000:2.0:1788568719.855949:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 5 00000100:00100000:2.0:1788568719.856067:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+25:10442:x1875449958405248:12345-192.168.206.4@tcp:103:lfs.0 00010000:00010000:2.0:1788568719.856087:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788568719.856115:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a11d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb6c expref: 25 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.856138:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a122c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb81 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.856152:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a10d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb2d expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.856163:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae255fb9500) 00010000:00010000:2.0:1788568719.856177:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568719.856482:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+22:10442:x1875449958405248:12345-192.168.206.4@tcp:103:lfs.0 Request processed in 521us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568719.856491:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 5 00000100:00100000:2.0:1788568719.859062:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568719.859168:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958405376 00000100:00100000:3.0:1788568719.859316:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958405376 00000100:00100000:3.0:1788568719.859435:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 66 00000100:00100000:3.0:1788568719.859448:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+22:10442:x1875449958405376:12345-192.168.206.4@tcp:58:lfs.0 00010000:00010000:3.0:1788568719.859606:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1248 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568719.859636:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1248 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568719.859652:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1248 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788568719.860622:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788568719.861268:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1788568719.861357:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1788568719.861509:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+22:10442:x1875449958405376:12345-192.168.206.4@tcp:58:lfs.0 Request processed in 2056us (2587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568719.861521:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 66 00000100:00100000:3.0:1788568719.901046:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568719.901276:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958405504 00000100:00100000:2.0:1788568719.901289:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958405504 00000100:00100000:2.0:1788568719.901361:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 67 00000100:00100000:2.0:1788568719.901374:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2530f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+22:10444:x1875449958405504:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:2.0:1788568719.901417:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568719.901444:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a124f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beb8f expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.901542:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1256 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.901559:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1256 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.901572:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1256 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.901589:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a125d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.901595:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a125d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.901601:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a125d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.901904:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1264 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.901914:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1264 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.901923:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1264 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788568719.902269:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788568719.902281:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788568719.902307:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1264 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.902321:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1264 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.902331:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1256 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.902338:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1256 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.902347:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1256 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.902353:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7a200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568719.902358:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1256 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.902366:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1256 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.902379:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ae25820c700) 00010000:00010000:2.0:1788568719.902382:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788568719.902387:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1256 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.902394:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1256 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.902408:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a125d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.902425:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a125d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.902431:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a125d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.902436:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7bc00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568719.902439:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a125d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.902445:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a125d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.902453:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ae255fb9500) 00010000:00010000:2.0:1788568719.902456:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788568719.902459:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a125d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.902464:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a125d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.902506:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a124f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb8f expref: 24 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.902521:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1264 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb8f expref: 23 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568719.902529:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae2430add00) 00010000:00010000:2.0:1788568719.902531:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788568719.902539:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7aa00, rc 0) 00000100:00100000:2.0:1788568719.902634:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2530f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+23:10444:x1875449958405504:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 1261us (1602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568719.902643:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 67 00000040:00080000:3.0:1788568720.121748:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788568720.121763:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788568720.121823:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788568720.121832:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788568720.122011:0:11686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2530f5f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11686:1875449976259328:192.168.206.4@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788568720.122277:0:11686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2525123c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788568720.135868:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568720.136189:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958405632 00000100:00100000:0.0:1788568720.136202:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958405632 00000100:00100000:0.0:1788568720.136291:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 1 00000100:00100000:0.0:1788568720.136302:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:27f83c0c-e36b-48ce-9485-80051fd252dc+24:10456:x1875449958405632:12345-192.168.206.4@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788568720.136406:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:27f83c0c-e36b-48ce-9485-80051fd252dc+24:10456:x1875449958405632:12345-192.168.206.4@tcp:900:lhsmtool_posix.0 Request processed in 106us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568720.136415:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 1 00000100:00100000:1.0:1788568720.137742:0:11686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2530f5f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11686:1875449976259328:192.168.206.4@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788568720.140672:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568720.140914:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958405760 00000100:00100000:0.0:1788568720.140977:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958405760 00000100:00100000:0.0:1788568720.141049:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 68 00000100:00100000:0.0:1788568720.141060:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+23:10456:x1875449958405760:12345-192.168.206.4@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788568720.141101:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788568720.141387:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+23:10456:x1875449958405760:12345-192.168.206.4@tcp:53:lhsmtool_posix.0 Request processed in 327us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568720.141395:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 68 00000100:00100000:0.0:1788568720.145457:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568720.145899:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958405888 00000100:00100000:2.0:1788568720.145913:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958405888 00000100:00100000:2.0:1788568720.146017:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 69 00000100:00100000:2.0:1788568720.146029:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+23:10456:x1875449958405888:12345-192.168.206.4@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788568720.146127:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a126b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.146150:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a126b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.146165:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a126b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.148602:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1272 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.148625:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1272 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.148637:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1272 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.148676:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1279 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.150085:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1279 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.150128:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1279 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788568720.150177:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788568720.150182:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788568720.150277:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1279 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.150360:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a126b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.150368:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a126b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.150375:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a126b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.150381:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7bc00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568720.150386:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a126b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.150394:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a126b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.150407:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ae25820cd00) 00010000:00010000:2.0:1788568720.150410:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788568720.150415:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a126b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.150422:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a126b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.150967:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1272 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.150974:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1272 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.150980:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1272 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.150985:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7a200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568720.152471:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1272 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.152492:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1272 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.152508:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9ae255fb9500) 00010000:00010000:2.0:1788568720.152510:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788568720.152699:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1272 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.152708:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1272 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.152732:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1279 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.152738:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1279 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.152744:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1279 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.152767:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7be00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568720.152770:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1279 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.152776:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1279 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.152787:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae2430add00) 00010000:00010000:2.0:1788568720.152789:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788568720.152792:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1279 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.152797:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1279 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568720.152904:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+23:10456:x1875449958405888:12345-192.168.206.4@tcp:34:lhsmtool_posix.0 Request processed in 6872us (7455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568720.152919:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 69 00000100:00100000:2.0:1788568720.163046:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568720.163127:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958406144 00000100:00100000:3.0:1788568720.163146:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958406144 00000100:00100000:3.0:1788568720.163258:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 70 00000100:00100000:3.0:1788568720.163271:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+23:10456:x1875449958406144:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788568720.163298:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568720.163326:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a1280 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beb96 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.163455:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1287 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.163483:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1287 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.163498:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1287 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788568720.163513:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788568720.163647:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1287 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.163655:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1287 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.163662:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1287 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.163669:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429de600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568720.163673:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1287 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.163682:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1287 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.163695:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae2430add00) 00010000:00010000:3.0:1788568720.163698:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788568720.163703:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1287 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.163709:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1287 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.163756:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a1280 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb96 expref: 25 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.163774:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ae25820cd00) 00010000:00010000:3.0:1788568720.163776:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788568720.163781:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a1280 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb96 expref: 25 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.163791:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429dfe00, rc 0) 00000100:00100000:3.0:1788568720.163869:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+24:10456:x1875449958406144:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 601us (833us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1788568720.163877:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 70 00000100:00100000:1.0:1788568720.179696:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568720.186425:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958406272 00000100:00100000:0.0:1788568720.186439:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958406272 00000100:00100000:0.0:1788568720.186508:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 71 00000100:00100000:0.0:1788568720.186529:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+24:10456:x1875449958406272:12345-192.168.206.4@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788568720.186584:0:6714:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788568720.186690:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+24:10456:x1875449958406272:12345-192.168.206.4@tcp:53:lhsmtool_posix.0 Request processed in 163us (7003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568720.186698:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 71 00000100:00100000:1.0:1788568720.202590:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568720.202627:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958406528 00000100:00100000:1.0:1788568720.202636:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958406528 00000100:00100000:1.0:1788568720.202697:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 72 00000100:00100000:1.0:1788568720.202707:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277971f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+24:10456:x1875449958406528:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788568720.202726:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568720.202729:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788568720.202751:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a1241 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb88 expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.202770:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ae25820c700) 00010000:00010000:1.0:1788568720.202775:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788568720.202787:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1295 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beb9d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788568720.203553:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1788568720.203792:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a129c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.203808:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a129c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.203837:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a129c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.203897:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1295 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb9d expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.203912:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a129c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb9d expref: 25 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.203921:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ae25820c300) 00010000:00010000:1.0:1788568720.203959:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788568720.203962:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2ca00, rc 0) 00000100:00100000:1.0:1788568720.204026:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277971f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+25:10456:x1875449958406528:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 1320us (1444us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1788568720.204034:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 72 00000100:00100000:0.0:1788568720.215351:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568720.215468:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958406784 00000100:00100000:2.0:1788568720.215489:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958406784 00000100:00100000:2.0:1788568720.215629:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 73 00000100:00100000:2.0:1788568720.215641:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+25:10456:x1875449958406784:12345-192.168.206.4@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788568720.215707:0:6714:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568720.215733:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a129c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb9d expref: 25 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.215763:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ae25820c300) 00010000:00010000:2.0:1788568720.215788:0:6714:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788568720.215810:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a12aa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.215834:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a12aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.215845:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a12aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.215904:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a12b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x9ce18ea0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.215912:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a12b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9ce18ea0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.215920:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a12b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9ce18ea0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.216193:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a12aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.216202:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a12aa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.216207:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a12aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.216212:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7be00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568720.216216:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a12aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.216224:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a12aa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.216253:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ae25820c700) 00010000:00010000:2.0:1788568720.216255:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788568720.216259:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a12aa lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.216265:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a12aa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.216275:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a12b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9ce18ea0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.216281:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a12b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9ce18ea0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.216287:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a12b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9ce18ea0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.216292:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7a200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568720.216295:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a12b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9ce18ea0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.216300:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a12b1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9ce18ea0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.216307:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x9ce18ea0 (ffff9ae255fb9500) 00010000:00010000:2.0:1788568720.216309:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788568720.216312:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a12b1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9ce18ea0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.216317:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a12b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9ce18ea0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568720.216421:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+24:10456:x1875449958406784:12345-192.168.206.4@tcp:36:lhsmtool_posix.0 Request processed in 781us (1083us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788568720.216429:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 73 00000100:00100000:1.0:1788568720.221121:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568720.222767:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958406912 00000100:00100000:2.0:1788568720.222780:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958406912 00000100:00100000:2.0:1788568720.222923:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 74 00000100:00100000:2.0:1788568720.222953:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+24:10456:x1875449958406912:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788568720.222972:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568720.222994:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a12b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beba4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.223031:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a12bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.223044:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a12bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.223055:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a12bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.223164:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a12b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beba4 expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.223183:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a12bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beba4 expref: 25 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.223191:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ae255fb9100) 00010000:00010000:2.0:1788568720.223201:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788568720.223205:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7a600, rc 0) 00000100:00100000:2.0:1788568720.223333:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+25:10456:x1875449958406912:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 382us (2220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568720.223339:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 74 00000100:00100000:0.0:1788568720.229025:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568720.229139:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958407168 00000100:00100000:2.0:1788568720.229154:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958407168 00000100:00100000:2.0:1788568720.229227:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 75 00000100:00100000:2.0:1788568720.229248:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+25:10456:x1875449958407168:12345-192.168.206.4@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788568720.229323:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a12c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.229342:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a12c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.229355:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a12c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788568720.229786:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:2.0:1788568720.229796:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 354637868258ns, next at 355637866060ns, rc = 0 00000004:00010000:0.0:1788568720.230770:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004fe079f2 reply state 00000000422537ee transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a12c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568720.230784:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788568720.230918:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+27:10456:x1875449958407168:12345-192.168.206.4@tcp:36:lhsmtool_posix.0 Request processed in 1664us (1897us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1788568720.231037:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 75 00010000:00010000:1.0:1788568720.235116:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a12c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.235136:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a12c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.235144:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a12c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.235150:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7a200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568720.235156:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a12c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.235164:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a12c6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.235182:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ae255fb9100) 00010000:00010000:1.0:1788568720.235185:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788568720.235189:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a12c6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.235196:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a12c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568720.248222:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568720.248305:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958407296 00000100:00100000:2.0:1788568720.248315:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958407296 00000100:00100000:2.0:1788568720.248377:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 76 00000100:00100000:2.0:1788568720.248388:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277972680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+26:10456:x1875449958407296:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788568720.248420:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568720.248441:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a12cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bebab expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.248509:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a12cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebab expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.248532:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a12cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebab expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.248554:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ae255fb9100) 00010000:00010000:2.0:1788568720.248557:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788568720.248561:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7bc00, rc 0) 00000100:00100000:2.0:1788568720.248621:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277972680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+27:10456:x1875449958407296:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 235us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568720.248628:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 76 00000100:00100000:2.0:1788568720.256021:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568720.256085:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958407424 00000100:00100000:2.0:1788568720.256097:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958407424 00000100:00100000:2.0:1788568720.256192:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 25 00000100:00100000:2.0:1788568720.256204:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1875449958407424:12345-192.168.206.4@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1788568720.256254:0:6691:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 27f83c0c-e36b-48ce-9485-80051fd252dc@192.168.206.4@tcp t0 exp 0000000000000000 cur 354 last 0 00000020:00000080:2.0:1788568720.256303:0:6691:0:(genops.c:1385:class_connect()) connect: client 27f83c0c-e36b-48ce-9485-80051fd252dc, cookie 0x41e82f464b6a12d4 00002000:00100000:2.0:1788568720.256319:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 27f83c0c-e36b-48ce-9485-80051fd252dc/ffff9ae24a970000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788568720.256333:0:6691:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788568720.257049:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788568720.257095:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9ae24a974800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788568720.257397:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2360:x1875449958407424:12345-192.168.206.4@tcp:8:lhsmtool_posix.0 Request processed in 1191us (1388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568720.257410:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 25 00000100:00100000:3.0:1788568720.263869:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568720.264473:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958407552 00000100:00100000:2.0:1788568720.264506:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958407552 00000100:00100000:2.0:1788568720.264602:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 26 00000100:00100000:2.0:1788568720.264615:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2530f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+6:0:x1875449958407552:12345-192.168.206.4@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788568720.265664:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1788568720.376139:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:3.0:1788568720.376164:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 27f83c0c-e36b-48ce-9485-80051fd252dc 00000100:00100000:2.0:1788568720.376691:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2530f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+5:0:x1875449958407552:12345-192.168.206.4@tcp:2:lhsmtool_posix.0 Request processed in 112067us (112826us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788568720.376707:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 26 00000100:00100000:1.0:1788568720.379805:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568720.380063:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958407808 00000100:00100000:3.0:1788568720.380079:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958407808 00000100:00100000:3.0:1788568720.380153:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 19 00000100:00100000:3.0:1788568720.380166:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+27:10456:x1875449958407808:12345-192.168.206.4@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788568720.380482:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+28:10456:x1875449958407808:12345-192.168.206.4@tcp:35:lhsmtool_posix.0 Request processed in 318us (689us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1788568720.380490:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 19 00000100:00100000:1.0:1788568720.384440:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568720.384533:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958408064 00000100:00100000:2.0:1788568720.384546:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958408064 00000100:00100000:2.0:1788568720.384621:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 77 00000100:00100000:2.0:1788568720.384633:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277972300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+28:10456:x1875449958408064:12345-192.168.206.4@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788568720.384781:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277972300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+28:10456:x1875449958408064:12345-192.168.206.4@tcp:57:lhsmtool_posix.0 Request processed in 141us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568720.384789:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 77 00000100:00100000:0.0:1788568720.396068:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568720.396244:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958408192 00000100:00100000:1.0:1788568720.396260:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958408192 00000100:00100000:1.0:1788568720.396337:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 78 00000100:00100000:1.0:1788568720.396350:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+28:10456:x1875449958408192:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788568720.396381:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568720.396413:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a12db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bebb2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.396521:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a12e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.396540:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a12e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.396554:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a12e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568720.396600:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788568720.396624:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a12e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.396655:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a12db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebb2 expref: 30 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.396677:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a12e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebb2 expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.396686:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ae255fb9100) 00010000:00010000:1.0:1788568720.396696:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788568720.396701:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2d600, rc 0) 00000100:00100000:1.0:1788568720.396785:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+29:10456:x1875449958408192:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 438us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568720.396793:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 78 00000100:00100000:3.0:1788568720.399426:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568720.400215:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958408320 00000100:00100000:0.0:1788568720.400245:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958408320 00000100:00100000:0.0:1788568720.400333:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 27 00000100:00100000:0.0:1788568720.400347:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2530f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2364:x1875449958408320:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788568720.400376:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568720.400408:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8030429/0x41e82f464b6a12e9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bebb9 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788568720.400459:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b648f, blocks: 0x1 00010000:00010000:0.0:1788568720.400485:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=354s v=(0 0) 00010000:00010000:0.0:1788568720.400490:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788568720.400502:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8030429/0x41e82f464b6a12e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebb9 expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568720.400528:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f8030429/0x41e82f464b6a12e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebb9 expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568720.400544:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae27feaa400, rc 0) 00000100:00100000:0.0:1788568720.400633:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2530f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2364:x1875449958408320:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 290us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568720.400641:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 27 00000100:00100000:3.0:1788568720.419733:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568720.420064:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958408576 00000100:00100000:0.0:1788568720.420079:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958408576 00000100:00100000:0.0:1788568720.420158:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 79 00000100:00100000:0.0:1788568720.420171:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2530f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+29:10456:x1875449958408576:12345-192.168.206.4@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788568720.420333:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2530f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+29:10456:x1875449958408576:12345-192.168.206.4@tcp:57:lhsmtool_posix.0 Request processed in 163us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568720.420348:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 79 00000100:00100000:1.0:1788568720.430053:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568720.430420:0:8111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958408704 00000100:00100000:3.0:1788568720.430432:0:8111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958408704 00000100:00100000:3.0:1788568720.430578:0:8111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 28 00000100:00100000:3.0:1788568720.430592:0:8111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277971180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+6:10456:x1875449958408704:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788568720.430628:0:8111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568720.430659:0:8111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbb2afb4/0x41e82f464b6a12f0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bebc0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.430707:0:8111:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f8030429/0x41e82f464b6a12e9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebb9 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.430718:0:8111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788568720.430723:0:8111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788568720.430729:0:8111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbb2afb4/0x41e82f464b6a12f0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebc0 expref: 7 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.430773:0:8111:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f8030429/0x41e82f464b6a12e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebb9 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.430790:0:8111:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f8030429/0x41e82f464b6a12e9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebb9 expref: 7 pid: 6691 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568720.430806:0:8111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2530f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8111:1875449976259456:192.168.206.4@tcp:104: 00000100:00100000:3.0:1788568720.431623:0:8111:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae252512a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788568720.433898:0:8111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2530f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8111:1875449976259456:192.168.206.4@tcp:104: 00010000:00010000:2.0:1788568720.433969:0:8111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cbb2afb4/0x41e82f464b6a12f0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebc0 expref: 7 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.433999:0:8111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429dfe00, rc 0) 00000100:00100000:2.0:1788568720.434082:0:8111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277971180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+7:10456:x1875449958408704:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 3492us (4037us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568720.434093:0:8111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 28 00000100:00100000:3.0:1788568720.434129:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568720.434312:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958408832 00000100:00100000:3.0:1788568720.434337:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958408832 00010000:00010000:3.0:1788568720.434379:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f8030429/0x41e82f464b6a12e9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebb9 expref: 7 pid: 6691 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568720.434437:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 42 00000100:00100000:3.0:1788568720.434447:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25319f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+7:2363:x1875449958408832:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788568720.434463:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568720.434492:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f8030429/0x41e82f464b6a12e9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebb9 expref: 7 pid: 6691 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.434638:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f8030429/0x41e82f464b6a12e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebb9 expref: 7 pid: 6691 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.434666:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8030429/0x41e82f464b6a12e9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebb9 expref: 7 pid: 6691 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.434678:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788568720.434682:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788568720.434692:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cbb2afb4/0x41e82f464b6a12f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebc0 expref: 6 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.434705:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbb2afb4/0x41e82f464b6a12f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebc0 expref: 6 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.434748:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cbb2afb4/0x41e82f464b6a12f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebc0 expref: 6 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568720.434765:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2530f7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5828:1875449976259584:192.168.206.4@tcp:105: 00000100:00100000:3.0:1788568720.434947:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae252512540 going to sleep for 11 seconds 00000100:00100000:1.0:1788568720.441001:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2530f7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5828:1875449976259584:192.168.206.4@tcp:105: 00010000:00010000:1.0:1788568720.441040:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788568720.441113:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25319f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2363:x1875449958408832:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 6665us (7307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568720.441138:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 42 00000100:00100000:3.0:1788568720.441205:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568720.441458:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958408960 00000100:00100000:3.0:1788568720.441468:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958408960 00002000:00100000:3.0:1788568720.441530:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9ae2530f5f80 x1875449958408960/t0(0) o4->27f83c0c-e36b-48ce-9485-80051fd252dc@192.168.206.4@tcp:156/0 lens 504/0 e 0 to 0 dl 1788568731 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788568720.441542:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae2530f5f80 with x1875449958408960 ext(0->8) 00002000:00010000:3.0:1788568720.441553:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ae2530f5f80 00000100:00100000:3.0:1788568720.441583:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 0 00000100:00100000:1.0:1788568720.441589:0:6695:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788568720.441592:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2530f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2364:x1875449958408960:12345-192.168.206.4@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788568720.441597:0:6695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1788568720.447573:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2530f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+8:2364:x1875449958408960:12345-192.168.206.4@tcp:4:lhsmtool_posix.0 Request processed in 5969us (6357us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788568720.447590:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 0 00002000:00100000:3.0:1788568720.447603:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9ae2530f5f80 x1875449958408960/t4294967302(0) o4->27f83c0c-e36b-48ce-9485-80051fd252dc@192.168.206.4@tcp:156/0 lens 504/448 e 0 to 0 dl 1788568731 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788568720.447613:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae2530f5f80 with x1875449958408960 ext(0->8) 00002000:00010000:3.0:1788568720.447619:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ae2530f5f80 00000100:00100000:3.0:1788568720.450537:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568720.450660:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958409088 00000100:00100000:0.0:1788568720.450673:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958409088 00000100:00100000:0.0:1788568720.450816:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 80 00000100:00100000:0.0:1788568720.450834:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2530f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+29:10456:x1875449958409088:12345-192.168.206.4@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788568720.518395:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967346 is committed 00000001:00080000:2.0:1788568720.518419:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000001:00080000:2.0:1788568720.518444:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:2.0:1788568720.518448:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000001:00080000:2.0:1788568720.518480:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:2.0:1788568720.518507:0:5865:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:2.0:1788568720.518658:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1788568720.518671:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788568720.518690:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244b37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976259712:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788568720.518836:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568720.518967:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976259712 00000100:00100000:2.0:1788568720.518976:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976259712 00000100:00100000:2.0:1788568720.519049:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788568720.519059:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae1419bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976259712:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788568720.519270:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788568720.519275:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788568719 00002000:00010000:2.0:1788568720.519279:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788568720.519281:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788568719 -> 1788568719 00002000:00010000:2.0:1788568720.519284:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788568720.519339:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae1419bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875449976259712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 280us (567us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788568720.519347:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1788568720.519375:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788568720.519435:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ae244b37b80/2, rc 0, transno 4294967303 00000100:00100000:2.0:1788568720.519442:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244b37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976259712:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788568720.519584:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2530f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+13:10456:x1875449958409088:12345-192.168.206.4@tcp:44:lhsmtool_posix.0 Request processed in 68755us (69054us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568720.519594:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 80 00000100:00100000:2.0:1788568720.529038:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568720.529763:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958409216 00000100:00100000:3.0:1788568720.529778:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958409216 00000100:00100000:3.0:1788568720.529847:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 30 00000100:00100000:3.0:1788568720.529857:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281b00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+8:2362:x1875449958409216:12345-192.168.206.4@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1788568720.567585:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788568720.573620:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:3.0:1788568720.573639:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:2.0:1788568720.574799:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281b00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2362:x1875449958409216:12345-192.168.206.4@tcp:16:lhsmtool_posix.0 Request processed in 44936us (45768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568720.574812:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 30 00000100:00100000:3.0:1788568720.583422:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568720.583547:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958409472 00000100:00100000:1.0:1788568720.583557:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958409472 00000100:00100000:1.0:1788568720.583654:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 81 00000100:00100000:1.0:1788568720.583665:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2530f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+13:10456:x1875449958409472:12345-192.168.206.4@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788568720.583720:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788568720.583747:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a12e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebb2 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.583767:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ae255fb9100) 00010000:00010000:1.0:1788568720.583772:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788568720.583800:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a12f7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.583814:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a12f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.583843:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a12f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788568720.584197:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dfa92a6b reply state 00000000c87b2a1f transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a12f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568720.584206:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788568720.584365:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2530f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+14:10456:x1875449958409472:12345-192.168.206.4@tcp:36:lhsmtool_posix.0 Request processed in 700us (950us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1788568720.584372:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 81 00000100:00100000:3.0:1788568720.588988:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568720.589051:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958409600 00000100:00100000:2.0:1788568720.589067:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958409600 00000100:00100000:2.0:1788568720.589157:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 31 00000100:00100000:2.0:1788568720.589169:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2530f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2364:x1875449958409600:12345-192.168.206.4@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788568720.589426:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788568720.589430:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788568719 -> 1788568718 00002000:00010000:2.0:1788568720.589432:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788568716 00002000:00010000:2.0:1788568720.589435:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788568719 -> 1788568718 00002000:00010000:2.0:1788568720.589437:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788568720.589507:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2530f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+7:2364:x1875449958409600:12345-192.168.206.4@tcp:2:lhsmtool_posix.0 Request processed in 339us (581us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788568720.589515:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 31 00010000:00010000:0.0:1788568720.592413:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a12f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568720.592430:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a12f7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568720.592438:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a12f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568720.592445:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2c200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568720.592450:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a12f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568720.592458:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a12f7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568720.592476:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ae255fb9100) 00010000:00010000:0.0:1788568720.592479:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788568720.592484:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a12f7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568720.592490:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a12f7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568720.600063:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568720.600202:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958409856 00000100:00100000:2.0:1788568720.600213:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958409856 00000100:00100000:2.0:1788568720.600342:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 82 00000100:00100000:2.0:1788568720.600354:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+13:10456:x1875449958409856:12345-192.168.206.4@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788568720.600417:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a12fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.600433:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a12bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beba4 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.600442:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a12fe lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.600476:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a12bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beba4 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.600491:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a12bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beba4 expref: 13 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568720.600519:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae281b00380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875449976259840:192.168.206.4@tcp:104: 00000100:00100000:2.0:1788568720.600603:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae25265b300 going to sleep for 11 seconds 00000100:00100000:0.0:1788568720.606124:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae281b00380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875449976259840:192.168.206.4@tcp:104: 00010000:00010000:0.0:1788568720.606160:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a12fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568720.616059:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568720.616739:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958409984 00000100:00100000:1.0:1788568720.616751:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958409984 00010000:00010000:1.0:1788568720.616802:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a12bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beba4 expref: 14 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568720.616848:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 43 00000100:00100000:1.0:1788568720.616862:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+14:2363:x1875449958409984:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788568720.616878:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788568720.616886:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a12bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beba4 expref: 14 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.616901:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a12bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beba4 expref: 14 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.616968:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a12bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beba4 expref: 14 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.617000:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ae255fb9100) 00010000:00010000:1.0:1788568720.617006:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a12fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.617016:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a12fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.617023:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a12fe lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.617187:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788568720.617210:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a12fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568720.617239:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a12fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568720.617266:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+13:2363:x1875449958409984:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 407us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568720.617275:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 43 00010000:00010000:0.0:1788568720.617280:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a12fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568720.617291:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a12fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568720.617300:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a12fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568720.617306:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7be00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568720.617311:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a12fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568720.617425:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a12fe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568720.617443:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ae255fb9100) 00010000:00010000:0.0:1788568720.617447:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788568720.617452:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a12fe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568720.617474:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a12fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568720.617555:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+12:10456:x1875449958409856:12345-192.168.206.4@tcp:55:lhsmtool_posix.0 Request processed in 17200us (17498us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788568720.617567:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 82 00000100:00100000:3.0:1788568720.622678:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568720.624225:0:8111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958410112 00000100:00100000:1.0:1788568720.624248:0:8111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958410112 00000100:00100000:1.0:1788568720.624317:0:8111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 32 00000100:00100000:1.0:1788568720.624328:0:8111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2530f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+7:2362:x1875449958410112:12345-192.168.206.4@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788568720.624373:0:8111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008620b04f/0x41e82f464b6a1305 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.624392:0:8111:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cbb2afb4/0x41e82f464b6a12f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebc0 expref: 7 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.624401:0:8111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788568720.624405:0:8111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788568720.624410:0:8111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008620b04f/0x41e82f464b6a1305 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.624460:0:8111:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cbb2afb4/0x41e82f464b6a12f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebc0 expref: 7 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.624473:0:8111:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cbb2afb4/0x41e82f464b6a12f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebc0 expref: 7 pid: 8111 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568720.624487:0:8111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277971500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8111:1875449976259968:192.168.206.4@tcp:104: 00000100:00100000:1.0:1788568720.624582:0:8111:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae250ae4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788568720.628313:0:8111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277971500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8111:1875449976259968:192.168.206.4@tcp:104: 00010000:00010000:0.0:1788568720.628362:0:8111:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008620b04f/0x41e82f464b6a1305 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568720.630513:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568720.632172:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958410240 00000100:00100000:2.0:1788568720.632187:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958410240 00010000:00010000:2.0:1788568720.632249:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cbb2afb4/0x41e82f464b6a12f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebc0 expref: 8 pid: 8111 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568720.632312:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 44 00000100:00100000:2.0:1788568720.632323:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cd87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+8:2363:x1875449958410240:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788568720.632340:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568720.632365:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cbb2afb4/0x41e82f464b6a12f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebc0 expref: 8 pid: 8111 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.632380:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cbb2afb4/0x41e82f464b6a12f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebc0 expref: 8 pid: 8111 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.632408:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbb2afb4/0x41e82f464b6a12f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebc0 expref: 8 pid: 8111 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.632430:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788568720.632435:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788568720.632442:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008620b04f/0x41e82f464b6a1305 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.632452:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008620b04f/0x41e82f464b6a1305 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.632502:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568720.632582:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cd87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+7:2363:x1875449958410240:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 258us (2078us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568720.632592:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 44 00010000:00010000:2.0:1788568720.632626:0:8111:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008620b04f/0x41e82f464b6a1305 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.632637:0:8111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008620b04f/0x41e82f464b6a1305 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.632664:0:8111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008620b04f/0x41e82f464b6a1305 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.632676:0:8111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008620b04f/0x41e82f464b6a1305 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.632686:0:8111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008620b04f/0x41e82f464b6a1305 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.632695:0:8111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2d600 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:2.0:1788568720.632701:0:8111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008620b04f/0x41e82f464b6a1305 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.632710:0:8111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008620b04f/0x41e82f464b6a1305 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.632740:0:8111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008620b04f/0x41e82f464b6a1305 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.632748:0:8111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008620b04f/0x41e82f464b6a1305 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568720.632800:0:8111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2530f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2362:x1875449958410112:12345-192.168.206.4@tcp:1:lhsmtool_posix.0 Request processed in 8474us (10132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568720.632810:0:8111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 32 00000100:00100000:3.0:1788568720.635640:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568720.636607:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958410496 00000100:00100000:1.0:1788568720.636624:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958410496 00000100:00100000:1.0:1788568720.636716:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 83 00000100:00100000:1.0:1788568720.636732:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cd86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+12:10456:x1875449958410496:12345-192.168.206.4@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788568720.636840:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ce00/0x41e82f464b6a130c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.636860:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ce00/0x41e82f464b6a130c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.636875:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ce00/0x41e82f464b6a130c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.637206:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a1313 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.637219:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a12cd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebab expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.637258:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a1313 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.637305:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a12cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebab expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.638165:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a12cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebab expref: 13 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568720.638192:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277970700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1875449976260096:192.168.206.4@tcp:104: 00000100:00100000:1.0:1788568720.638447:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae25318e540 going to sleep for 11 seconds 00000100:00100000:3.0:1788568720.647769:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568720.647828:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277970700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1875449976260096:192.168.206.4@tcp:104: 00010000:00010000:1.0:1788568720.647868:0:6714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a1313 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568720.647909:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958410624 00000100:00100000:1.0:1788568720.647917:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958410624 00010000:00010000:1.0:1788568720.647978:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a12cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebab expref: 14 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568720.648025:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 45 00000100:00100000:1.0:1788568720.648038:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cd85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+14:2363:x1875449958410624:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788568720.648057:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788568720.648067:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a12cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebab expref: 14 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.648102:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a12cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebab expref: 14 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.648131:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a12cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebab expref: 14 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.648153:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ae255fb9100) 00010000:00010000:1.0:1788568720.648159:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a1313 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.648170:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a1313 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.648180:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a1313 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.648213:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788568720.648260:0:6714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a1313 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.648272:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a1313 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568720.648301:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cd85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+13:2363:x1875449958410624:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 263us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568720.648313:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 45 00000001:00080000:3.0:1788568720.648462:0:6714:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1788568720.648613:0:6714:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1788568720.648661:0:6714:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1788568720.648749:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cd85500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6714:1875449976260224:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788568720.648807:0:6714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568720.648850:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae26fb730c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788568720.648863:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976260224 00000100:00100000:0.0:1788568720.648872:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976260224 00000100:00100000:0.0:1788568720.648949:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788568720.648962:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cd84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6714:x1875449976260224:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788568720.649091:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cd84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6714:x1875449976260224:12345-0@lo:1000:mdt00_003.0 Request processed in 134us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568720.649100:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788568720.649138:0:6714:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1788568720.649145:0:6714:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ae244b37b80, transno 4294967303 00000100:00100000:3.0:1788568720.649167:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cd85500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6714:1875449976260224:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1788568720.649620:0:6714:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1788568720.649672:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cd85500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6714:1875449976260352:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788568720.649719:0:6714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568720.649750:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae252512a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788568720.650738:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976260352 00000100:00100000:1.0:1788568720.650752:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976260352 00000100:00100000:1.0:1788568720.650814:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788568720.650826:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cd87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6714:x1875449976260352:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788568720.652556:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cd87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6714:x1875449976260352:12345-0@lo:1000:mdt00_003.0 Request processed in 1722us (2825us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788568720.652573:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788568720.655299:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cd85500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6714:1875449976260352:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788568720.655384:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a1313 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.655396:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a1313 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.655405:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a1313 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.655411:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2da00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568720.655417:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a1313 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.655426:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a1313 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.655446:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ae255fb9100) 00010000:00010000:3.0:1788568720.655450:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788568720.655455:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a1313 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.655463:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a1313 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.655515:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1248 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.655522:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1248 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.655528:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1248 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.655544:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429de800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568720.655548:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1248 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.655555:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1248 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.655565:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae2430add00) 00010000:00010000:3.0:1788568720.655568:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788568720.655572:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1248 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.655579:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1248 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.655622:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a131a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.655640:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1264 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb8f expref: 16 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.655651:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a131a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.655697:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1264 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb8f expref: 16 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.655716:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1264 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb8f expref: 16 pid: 6714 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568720.655744:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cd85880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1875449976260480:192.168.206.4@tcp:104: 00000100:00100000:3.0:1788568720.655858:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae252512a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788568720.660340:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cd85880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1875449976260480:192.168.206.4@tcp:104: 00010000:00010000:0.0:1788568720.660384:0:6714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a131a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568720.671204:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568720.671282:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958410752 00000100:00100000:2.0:1788568720.671298:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958410752 00010000:00010000:2.0:1788568720.671347:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1264 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb8f expref: 17 pid: 6714 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568720.671396:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 46 00000100:00100000:2.0:1788568720.671410:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277970700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+17:2363:x1875449958410752:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788568720.671426:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568720.671433:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1264 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb8f expref: 17 pid: 6714 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.671446:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1264 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb8f expref: 17 pid: 6714 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.671466:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1264 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beb8f expref: 17 pid: 6714 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.671502:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae2430add00) 00010000:00010000:2.0:1788568720.671509:0:6705:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a131a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.671519:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a131a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.671526:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a131a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568720.671570:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568720.671645:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277970700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+16:2363:x1875449958410752:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 237us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568720.671653:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 46 00010000:00010000:3.0:1788568720.671731:0:6714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a131a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.671741:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a131a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.671753:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a131a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.671760:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a131a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.671767:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a131a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.671773:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429de600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568720.671777:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a131a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.671784:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a131a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.671795:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae2430add00) 00010000:00010000:3.0:1788568720.671798:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788568720.671802:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a131a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.671867:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a131a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.671892:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ce00/0x41e82f464b6a130c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.671898:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ce00/0x41e82f464b6a130c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.671905:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ce00/0x41e82f464b6a130c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.671910:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2ce00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568720.671914:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ce00/0x41e82f464b6a130c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.671921:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ce00/0x41e82f464b6a130c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.671972:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae2430add00) 00010000:00010000:3.0:1788568720.671975:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788568720.671978:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ce00/0x41e82f464b6a130c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.671985:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ce00/0x41e82f464b6a130c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568720.672212:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cd86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+15:10456:x1875449958410496:12345-192.168.206.4@tcp:57:lhsmtool_posix.0 Request processed in 35483us (36583us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1788568720.672223:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 83 00000020:00080000:3.0:1788568720.672236:0:6714:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788568720.672412:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788568720.672420:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788568720.672453:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788568720.672459:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788568720.678388:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568720.678469:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958411008 00000100:00100000:3.0:1788568720.678480:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958411008 00000100:00100000:3.0:1788568720.678559:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 20 00000100:00100000:3.0:1788568720.678569:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+15:10456:x1875449958411008:12345-192.168.206.4@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788568720.681656:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788568720.681791:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1788568720.681880:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1321 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.681896:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1321 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.681908:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1321 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.681917:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1321 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.681923:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1321 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.681952:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1321 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.681998:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788568720.682125:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+17:10456:x1875449958411008:12345-192.168.206.4@tcp:35:lhsmtool_posix.0 Request processed in 3552us (3741us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1788568720.682135:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 20 00000020:00080000:3.0:1788568720.682141:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788568720.683175:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788568720.683185:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1321 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.683194:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429de800 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:1.0:1788568720.683198:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1321 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.683206:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1321 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.683222:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ae2430ad600) 00010000:00010000:1.0:1788568720.683226:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788568720.683239:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1321 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.683246:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1321 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.683276:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568720.683278:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568720.683280:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788568720.786450:0:12007:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788568720.786458:0:12007:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788568720.786490:0:12007:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788568720.786496:0:12007:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788568720.916467:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568720.916541:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958411136 00000100:00100000:0.0:1788568720.916551:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958411136 00000100:00100000:0.0:1788568720.916616:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 287 00000100:00100000:0.0:1788568720.916628:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+13:2364:x1875449958411136:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:0.0:1788568720.916715:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+13:2364:x1875449958411136:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 89us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568720.916730:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 287 00000100:00100000:0.0:1788568720.920819:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568720.920897:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958411264 00000100:00100000:3.0:1788568720.920907:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958411264 00000100:00100000:3.0:1788568720.921000:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 76 00000100:00100000:3.0:1788568720.921021:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2363:x1875449958411264:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:3.0:1788568720.921087:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2363:x1875449958411264:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 69us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568720.921094:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 76 00000100:00080000:0.0:1788568720.922503:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788568720.930131:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568720.930206:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958411392 00000100:00100000:3.0:1788568720.930216:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958411392 00000100:00100000:3.0:1788568720.930286:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 136 00000100:00100000:3.0:1788568720.930296:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2364:x1875449958411392:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:3.0:1788568720.930361:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2364:x1875449958411392:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 66us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568720.930369:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 136 00000100:00080000:0.0:1788568720.930426:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788568720.972204:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568720.972284:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958411648 00000100:00100000:1.0:1788568720.972300:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958411648 00000100:00100000:1.0:1788568720.972349:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 84 00000100:00100000:1.0:1788568720.972358:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cd85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+17:10466:x1875449958411648:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:1.0:1788568720.972392:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568720.972410:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2cc00/0x41e82f464b6a1328 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bebc7 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.972488:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ce00/0x41e82f464b6a132f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.972502:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ce00/0x41e82f464b6a132f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.972513:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ce00/0x41e82f464b6a132f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568720.972523:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788568720.972624:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2cc00/0x41e82f464b6a1328 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebc7 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.972641:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ce00/0x41e82f464b6a132f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebc7 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568720.972650:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ae25820c700) 00010000:00010000:1.0:1788568720.972652:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788568720.972656:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2ce00, rc 0) 00000100:00100000:1.0:1788568720.972702:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cd85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+19:10466:x1875449958411648:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 345us (507us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1788568720.972708:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 84 00000100:00100000:0.0:1788568720.979781:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568720.980283:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958411776 00000100:00100000:3.0:1788568720.980302:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958411776 00000100:00100000:3.0:1788568720.980358:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 85 00000100:00100000:3.0:1788568720.980368:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+19:10466:x1875449958411776:12345-192.168.206.4@tcp:34:lfs.0 00010000:00010000:3.0:1788568720.980599:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a133d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.980616:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a133d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.980627:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a133d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.980642:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1344 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.980663:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.980671:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.980886:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a134b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.980895:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a134b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.980902:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a134b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788568720.982650:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a134b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.982672:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a133d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.982679:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a133d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.982685:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a133d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.982691:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429de600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568720.982694:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a133d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.982702:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a133d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.982724:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ae25820c700) 00010000:00010000:3.0:1788568720.982726:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788568720.982731:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a133d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.982737:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a133d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.982749:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.982755:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1344 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.982761:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1344 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.982765:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429dee00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568720.982768:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1344 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.982774:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1344 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.982781:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ae2430add00) 00010000:00010000:3.0:1788568720.982784:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788568720.982787:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1344 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.982792:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1344 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.982819:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a134b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.982825:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a134b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.982831:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a134b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.982836:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429de800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568720.982839:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a134b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.982844:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a134b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.982852:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae2430ad700) 00010000:00010000:3.0:1788568720.982854:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788568720.982857:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a134b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568720.982862:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a134b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568720.985121:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+19:10466:x1875449958411776:12345-192.168.206.4@tcp:34:lfs.0 Request processed in 4745us (5339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568720.985136:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 85 00000100:00100000:0.0:1788568721.090004:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568721.090678:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958412032 00000100:00100000:1.0:1788568721.090689:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958412032 00000100:00080000:0.0:1788568721.090832:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788568721.092006:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 86 00000100:00100000:1.0:1788568721.092043:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+19:10469:x1875449958412032:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:1.0:1788568721.092064:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568721.092090:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2cc00/0x41e82f464b6a1352 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bebce expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.092158:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1359 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.092173:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1359 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.092184:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1359 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.092199:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a1360 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.092206:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a1360 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.092213:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a1360 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.092484:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a1367 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.092494:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a1367 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.092501:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a1367 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568721.092521:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788568721.092616:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1359 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.092624:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1359 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.092631:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1359 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.092638:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2d200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568721.092642:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1359 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.092650:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1359 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.092662:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ae25820c700) 00010000:00010000:1.0:1788568721.092665:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568721.092670:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1359 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.092677:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1359 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.092689:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a1360 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.092695:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a1360 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.092711:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a1360 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.092716:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2c000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568721.092720:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a1360 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.092726:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a1360 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.092734:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ae25820cb00) 00010000:00010000:1.0:1788568721.092737:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568721.092740:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a1360 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.092746:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a1360 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.093052:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2cc00/0x41e82f464b6a1352 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebce expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.093071:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a1367 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebce expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.093080:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae25820c400) 00010000:00010000:1.0:1788568721.093082:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788568721.093086:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2da00, rc 0) 00000100:00100000:1.0:1788568721.093159:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+21:10469:x1875449958412032:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 1122us (3162us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1788568721.093179:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 86 00000100:00100000:2.0:1788568721.099176:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568721.099294:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958412160 00000100:00100000:0.0:1788568721.099304:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958412160 00000100:00100000:0.0:1788568721.099363:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 87 00000100:00100000:0.0:1788568721.099378:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281b01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+21:10469:x1875449958412160:12345-192.168.206.4@tcp:54:lfs.0 00010000:00010000:0.0:1788568721.099463:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1375 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.099486:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1375 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.099498:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1375 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.099534:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1375 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.099545:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1375 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.099555:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1375 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.099579:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feab000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568721.099584:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1375 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.099596:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1375 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.099611:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae25820c400) 00010000:00010000:0.0:1788568721.099614:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788568721.099621:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1375 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.099626:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1375 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568721.099717:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281b01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+21:10469:x1875449958412160:12345-192.168.206.4@tcp:54:lfs.0 Request processed in 341us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568721.099729:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 87 00000100:00100000:0.0:1788568721.103576:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568721.103641:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958412416 00000100:00100000:1.0:1788568721.103652:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958412416 00000100:00100000:1.0:1788568721.103706:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 21 00000100:00100000:1.0:1788568721.103716:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24926d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+21:10469:x1875449958412416:12345-192.168.206.4@tcp:35:lfs.0 00000100:00100000:1.0:1788568721.103969:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24926d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+22:10469:x1875449958412416:12345-192.168.206.4@tcp:35:lfs.0 Request processed in 253us (400us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1788568721.103976:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 21 00000100:00100000:1.0:1788568721.156142:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568721.156264:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958412672 00000100:00100000:3.0:1788568721.156275:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958412672 00000100:00100000:3.0:1788568721.156343:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 88 00000100:00100000:3.0:1788568721.156368:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+22:9998:x1875449958412672:12345-192.168.206.4@tcp:101:bash.0 00010000:00010000:3.0:1788568721.156393:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568721.156414:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a137c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bebd5 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.156516:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1383 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.156531:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a1367 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebce expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.156540:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1383 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.156573:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a1367 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebce expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.156588:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a1367 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebce expref: 23 pid: 5843 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568721.156603:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cd84e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1875449976260608:192.168.206.4@tcp:104: 00000100:00100000:3.0:1788568721.158917:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae252512a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788568721.178857:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cd84e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1875449976260608:192.168.206.4@tcp:104: 00010000:00010000:3.0:1788568721.178888:0:6714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1383 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568721.179098:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568721.179342:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958412800 00000100:00100000:3.0:1788568721.179350:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958412800 00010000:00010000:3.0:1788568721.179399:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a1367 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebce expref: 24 pid: 5843 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568721.179439:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 47 00000100:00100000:3.0:1788568721.179448:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277973b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+24:2364:x1875449958412800:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788568721.179464:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568721.179470:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a1367 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebce expref: 24 pid: 5843 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.179483:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a1367 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebce expref: 24 pid: 5843 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.179502:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a1367 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebce expref: 24 pid: 5843 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.179517:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae25820c400) 00010000:00010000:3.0:1788568721.179522:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1383 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.179531:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1383 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.179538:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1383 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.179569:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788568721.179673:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277973b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+23:2364:x1875449958412800:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 225us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568721.179680:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 47 00010000:00010000:0.0:1788568721.179812:0:6714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1383 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.179821:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1383 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788568721.179838:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788568721.180026:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a137c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebd5 expref: 24 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.180041:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1383 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebd5 expref: 23 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.180054:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae25820c400) 00010000:00010000:0.0:1788568721.180057:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788568721.180059:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429dee00, rc 0) 00000100:00100000:0.0:1788568721.180089:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+23:9998:x1875449958412672:12345-192.168.206.4@tcp:101:bash.0 Request processed in 23724us (23957us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1788568721.180097:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 88 00000100:00100000:2.0:1788568721.186859:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568721.189360:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958413056 00000100:00100000:0.0:1788568721.189375:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958413056 00000100:00100000:0.0:1788568721.189439:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 89 00000100:00100000:0.0:1788568721.189449:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281b03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+23:9998:x1875449958413056:12345-192.168.206.4@tcp:36:bash.0 00010000:00010000:0.0:1788568721.189696:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1391 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.189712:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1391 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.189724:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1391 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788568721.189791:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1788568721.189817:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ac8fb8df reply state 000000009302e69e transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1391 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568721.189826:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788568721.189875:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1788568721.190019:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281b03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+27:9998:x1875449958413056:12345-192.168.206.4@tcp:36:bash.0 Request processed in 570us (3168us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1788568721.190028:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 89 00000020:00080000:0.0:1788568721.190046:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1788568721.193494:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1391 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.193511:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1391 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.193519:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1391 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.193524:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feab000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568721.193529:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1391 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.193543:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1391 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.193561:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae25820c400) 00010000:00010000:1.0:1788568721.193564:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568721.193584:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1391 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.193591:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1391 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568721.195676:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568721.203698:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958413184 00000100:00100000:1.0:1788568721.203712:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958413184 00000100:00100000:1.0:1788568721.203780:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 90 00000100:00100000:1.0:1788568721.203790:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281b02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+26:9998:x1875449958413184:12345-192.168.206.4@tcp:101:bash.0 00010000:00010000:1.0:1788568721.203821:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568721.203843:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2cc00/0x41e82f464b6a1398 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bebdc expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.203960:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2cc00/0x41e82f464b6a1398 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebdc expref: 27 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.203983:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2cc00/0x41e82f464b6a1398 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebdc expref: 27 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.204007:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae25820c400) 00010000:00010000:1.0:1788568721.204010:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788568721.204013:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2cc00, rc 0) 00000100:00100000:1.0:1788568721.204077:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281b02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+27:9998:x1875449958413184:12345-192.168.206.4@tcp:101:bash.0 Request processed in 285us (8406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568721.204087:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 90 00000100:00100000:2.0:1788568721.209498:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568721.219397:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958413312 00000100:00100000:3.0:1788568721.219411:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958413312 00000100:00100000:3.0:1788568721.219470:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 33 00000100:00100000:3.0:1788568721.219479:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f563050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+6:9998:x1875449958413312:12345-192.168.206.4@tcp:101:bash.0 00010000:00010000:3.0:1788568721.219497:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568721.219515:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df231d3b/0x41e82f464b6a139f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bebe3 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788568721.219540:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9b648e, atime: 0x6a9b648c, ctime: 0x6a9b648e, blocks: 0xb 00010000:00010000:3.0:1788568721.219561:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1788568721.219565:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788568721.219573:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df231d3b/0x41e82f464b6a139f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebe3 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.219589:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df231d3b/0x41e82f464b6a139f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebe3 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.219600:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429de600, rc 0) 00000100:00100000:3.0:1788568721.219654:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f563050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+7:9998:x1875449958413312:12345-192.168.206.4@tcp:101:bash.0 Request processed in 176us (10165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568721.219661:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 33 00000100:00100000:2.0:1788568721.225510:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568721.225584:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958413440 00000100:00100000:3.0:1788568721.225593:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958413440 00002000:00010000:3.0:1788568721.225628:0:6694:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1788568721.225633:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae281b03480 with x1875449958413440 ext(0->18446744073709551615) 00002000:00010000:3.0:1788568721.225643:0:6694:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ae281b03480. 00000100:00100000:3.0:1788568721.225677:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 1 00000100:00100000:3.0:1788568721.225698:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+7:2362:x1875449958413440:12345-192.168.206.4@tcp:10:bash.0 00002000:00010000:0.0:1788568721.226181:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788568721.226185:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788568718 -> 1788568720 00002000:00010000:0.0:1788568721.226188:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788568716 -> 1788568716 00002000:00010000:0.0:1788568721.226190:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788568718 -> 1788568720 00002000:00010000:0.0:1788568721.226192:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1788568721.226254:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+8:2362:x1875449958413440:12345-192.168.206.4@tcp:10:bash.0 Request processed in 556us (752us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788568721.226261:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 1 00002000:00010000:0.0:1788568721.226264:0:6694:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1788568721.226267:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae281b03480 with x1875449958413440 ext(0->18446744073709551615) 00002000:00010000:0.0:1788568721.226271:0:6694:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ae281b03480. 00000100:00100000:2.0:1788568721.370990:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568721.371182:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958413568 00000100:00100000:0.0:1788568721.371192:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958413568 00000100:00100000:0.0:1788568721.371262:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 91 00000100:00100000:0.0:1788568721.371275:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281b02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+27:10483:x1875449958413568:12345-192.168.206.4@tcp:34:lfs.0 00010000:00010000:0.0:1788568721.371346:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a13a6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.371364:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a13a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.371377:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a13a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.371392:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a13ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.371399:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a13ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.371420:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a13ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.371655:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a13b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.371664:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a13b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.371670:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a13b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788568721.371703:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a13b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.371713:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a13a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.371718:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a13a6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.371725:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a13a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.371746:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaa200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568721.371751:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a13a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.371758:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a13a6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.371770:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ae25820c700) 00010000:00010000:0.0:1788568721.371779:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788568721.371784:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a13a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.371790:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a13a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.371802:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a13ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.371808:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a13ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.371814:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a13ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.371819:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feabe00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568721.371821:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a13ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.371827:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a13ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.371834:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ae24515a700) 00010000:00010000:0.0:1788568721.371836:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788568721.371839:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a13ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.371844:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a13ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.371858:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a13b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.371870:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a13b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.371875:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a13b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.371880:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaa400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568721.371883:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a13b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.371888:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a13b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.371896:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae25820c400) 00010000:00010000:0.0:1788568721.371898:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788568721.371900:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a13b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.371905:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a13b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568721.373143:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281b02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+27:10483:x1875449958413568:12345-192.168.206.4@tcp:34:lfs.0 Request processed in 1864us (2156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568721.373156:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 91 00000100:00100000:2.0:1788568721.434524:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568721.434688:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958413824 00000100:00100000:1.0:1788568721.434697:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958413824 00000100:00100000:1.0:1788568721.434750:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 92 00000100:00100000:1.0:1788568721.434770:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281b01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+27:10486:x1875449958413824:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:1.0:1788568721.434788:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568721.434805:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a13bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bebea expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.434866:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a13c2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.434879:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a13c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.434889:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a13c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.434902:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a13c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.434909:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a13c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.434916:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a13c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.435206:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a13d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.435215:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a13d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.435222:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a13d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568721.435252:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788568721.435344:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a13c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.435352:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a13c2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.435358:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a13c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.435364:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2d600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568721.435368:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a13c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.435376:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a13c2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.435386:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ae25820c700) 00010000:00010000:1.0:1788568721.435389:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568721.435393:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a13c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.435402:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a13c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.435412:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a13c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.435419:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a13c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.435436:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a13c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.435440:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2c400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568721.435443:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a13c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.435449:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a13c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.435456:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ae25820cb00) 00010000:00010000:1.0:1788568721.435459:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568721.435462:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a13c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.435467:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a13c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.435504:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a13bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebea expref: 30 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.435517:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a13d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebea expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.435524:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae25820c400) 00010000:00010000:1.0:1788568721.435526:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788568721.435528:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2c200, rc 0) 00000100:00100000:1.0:1788568721.435590:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281b01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+29:10486:x1875449958413824:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 821us (1074us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1788568721.435606:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 92 00000100:00100000:1.0:1788568721.439474:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568721.439543:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958413952 00000100:00100000:3.0:1788568721.439552:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958413952 00000100:00100000:3.0:1788568721.439602:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 93 00000100:00100000:3.0:1788568721.439612:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277971880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+29:10486:x1875449958413952:12345-192.168.206.4@tcp:54:lfs.0 00010000:00010000:3.0:1788568721.439671:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a13de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.439685:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1383 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebd5 expref: 29 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.439694:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a13de lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.439721:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1383 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebd5 expref: 29 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.439733:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1383 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebd5 expref: 29 pid: 6714 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568721.439746:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cd84e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875449976260736:192.168.206.4@tcp:104: 00000100:00100000:3.0:1788568721.439825:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae252512840 going to sleep for 11 seconds 00000100:00100000:3.0:1788568721.442658:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cd84e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875449976260736:192.168.206.4@tcp:104: 00010000:00010000:3.0:1788568721.442685:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a13de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568721.443253:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568721.443332:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958414208 00000100:00100000:2.0:1788568721.443338:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958414208 00000100:00100000:2.0:1788568721.443388:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 22 00000100:00100000:2.0:1788568721.443409:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277971c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+30:5600:x1875449958414208:12345-192.168.206.4@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788568721.443739:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277971c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+31:5600:x1875449958414208:12345-192.168.206.4@tcp:35:ldlm_bl.0 Request processed in 330us (486us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1788568721.443747:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 22 00000100:00100000:2.0:1788568721.447384:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568721.447478:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958414336 00000100:00100000:3.0:1788568721.447499:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958414336 00010000:00010000:3.0:1788568721.447539:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1383 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebd5 expref: 31 pid: 6714 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568721.447583:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 48 00000100:00100000:3.0:1788568721.447594:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281b01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+31:2364:x1875449958414336:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788568721.447610:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568721.447618:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1383 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebd5 expref: 31 pid: 6714 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.447632:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1383 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebd5 expref: 31 pid: 6714 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.447655:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1383 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebd5 expref: 31 pid: 6714 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.447673:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae25820c400) 00010000:00010000:3.0:1788568721.447679:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a13de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.447690:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a13de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.447699:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a13de lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.447735:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788568721.447873:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a13de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.447882:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a13de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.447918:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a13de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.447968:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a13de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.447976:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a13de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.447981:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429dfe00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568721.447987:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a13de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.447995:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a13de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.448005:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae25820c400) 00010000:00010000:1.0:1788568721.448007:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788568721.448011:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a13de lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.448016:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a13de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568721.448253:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281b01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+30:2364:x1875449958414336:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 659us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568721.448272:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 48 00000100:00100000:1.0:1788568721.448710:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277971880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+29:10486:x1875449958413952:12345-192.168.206.4@tcp:54:lfs.0 Request processed in 9098us (9242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568721.448719:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 93 00000100:00100000:0.0:1788568721.451526:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568721.451631:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958414592 00000100:00100000:2.0:1788568721.451641:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958414592 00000100:00100000:2.0:1788568721.451726:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 23 00000100:00100000:2.0:1788568721.451737:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+29:10486:x1875449958414592:12345-192.168.206.4@tcp:35:lfs.0 00000100:00100000:2.0:1788568721.452160:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+30:10486:x1875449958414592:12345-192.168.206.4@tcp:35:lfs.0 Request processed in 424us (642us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788568721.452168:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 23 00000100:00100000:0.0:1788568721.548605:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568721.548712:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958414848 00000100:00100000:1.0:1788568721.548722:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958414848 00000100:00100000:1.0:1788568721.548782:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 94 00000100:00100000:1.0:1788568721.548793:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+30:10497:x1875449958414848:12345-192.168.206.4@tcp:101:cat.0 00010000:00010000:1.0:1788568721.548816:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568721.548836:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a13e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bebf1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.548905:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a13ec lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.548920:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a13ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.549085:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a13ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.549102:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a13f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.549109:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a13f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.549115:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a13f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.549441:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a13fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.549450:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a13fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.549457:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a13fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568721.549467:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1788568721.549555:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a13ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.549562:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a13ec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.549569:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a13ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.549574:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2d600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568721.549578:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a13ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.549586:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a13ec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.549596:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ae25820c700) 00010000:00010000:1.0:1788568721.549599:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568721.549604:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a13ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.549619:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a13ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.549631:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a13f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.549636:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a13f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.549642:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a13f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.549646:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2c600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568721.549649:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a13f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.549655:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a13f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.549662:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ae25820cb00) 00010000:00010000:1.0:1788568721.549665:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568721.549667:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a13f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.549673:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a13f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.549709:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a13e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebf1 expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.549721:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a13fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebf1 expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.549732:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae25820c400) 00010000:00010000:1.0:1788568721.549735:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788568721.549737:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2de00, rc 0) 00000100:00100000:1.0:1788568721.549846:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+32:10497:x1875449958414848:12345-192.168.206.4@tcp:101:cat.0 Request processed in 1054us (1249us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1788568721.549854:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 94 00000100:00100000:1.0:1788568721.555899:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568721.555990:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958415104 00000100:00100000:3.0:1788568721.555999:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958415104 00000100:00100000:3.0:1788568721.556051:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 24 00000100:00100000:3.0:1788568721.556061:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277971180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+32:10497:x1875449958415104:12345-192.168.206.4@tcp:35:cat.0 00000100:00100000:3.0:1788568721.556319:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277971180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+33:10497:x1875449958415104:12345-192.168.206.4@tcp:35:cat.0 Request processed in 259us (429us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1788568721.556327:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 24 00000100:00100000:0.0:1788568721.579909:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568721.580111:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958415360 00000100:00100000:1.0:1788568721.580121:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958415360 00000100:00100000:1.0:1788568721.580196:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 95 00000100:00100000:1.0:1788568721.580207:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+33:10498:x1875449958415360:12345-192.168.206.4@tcp:36:rm.0 00010000:00010000:1.0:1788568721.580278:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788568721.580304:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a13fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebf1 expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.580325:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a13d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebea expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.580337:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2cc00/0x41e82f464b6a1398 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebdc expref: 31 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.580347:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae25820c400) 00010000:00010000:1.0:1788568721.580357:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788568721.580376:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a1408 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.580401:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a1408 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.580410:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a1408 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.580427:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a140f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.580435:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a140f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.580442:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a140f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.580675:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1416 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.580684:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1416 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.580692:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1416 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788568721.581288:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1788568721.581298:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 355989370608ns, next at 356989368606ns, rc = 0 00010000:00010000:1.0:1788568721.581355:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a141d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.581365:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a141d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.581383:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a141d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.581390:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a141d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.581396:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a141d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.581401:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a141d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.581417:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788568721.581438:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1416 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.581444:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1416 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.581450:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1416 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.581455:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2d600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568721.581459:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1416 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.581466:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1416 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.581475:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae25820cf00) 00010000:00010000:1.0:1788568721.581478:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788568721.581489:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1416 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.581496:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1416 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.581512:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a1408 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.581519:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a1408 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.581524:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a1408 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.581529:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2c400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568721.581533:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a1408 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.581539:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a1408 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.581547:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ae25820c700) 00010000:00010000:1.0:1788568721.581550:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568721.581553:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a1408 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.581560:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a1408 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788568721.581569:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a0855e9 reply state 00000000cb0b5578 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a140f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568721.581588:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788568721.581667:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+32:10498:x1875449958415360:12345-192.168.206.4@tcp:36:rm.0 Request processed in 1459us (1765us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1788568721.581676:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 95 00010000:00010000:0.0:1788568721.582344:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788568721.582352:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a141d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.582371:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2d000 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788568721.582374:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a141d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.582382:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a141d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.582392:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ae25820cf00) 00010000:00010000:0.0:1788568721.582394:0:8455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788568721.582398:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a141d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.582404:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a141d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568721.582422:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568721.582425:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568721.582426:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568721.584776:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a140f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.584792:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a140f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.584799:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a140f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.584805:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2c600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568721.584809:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a140f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.584816:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a140f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.584831:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ae25820cb00) 00010000:00010000:1.0:1788568721.584834:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568721.584838:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a140f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.584845:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a140f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.592512:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568721.641547:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568721.641870:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958415616 00000100:00100000:3.0:1788568721.641879:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958415616 00000100:00100000:3.0:1788568721.641976:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 96 00000100:00100000:3.0:1788568721.641987:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+31:10504:x1875449958415616:12345-192.168.206.4@tcp:101:bash.0 00010000:00010000:3.0:1788568721.642009:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568721.642040:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1424 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bebf8 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.642150:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a142b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.642165:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a142b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.642609:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a142b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.642629:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1432 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.642654:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1432 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.642661:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1432 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788568721.643720:0:6714:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1788568721.644159:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a1439 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.644247:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a1439 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.644259:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a1439 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.644296:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a142b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.644303:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a142b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.644308:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a142b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.644314:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429df400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568721.644318:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a142b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.644325:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a142b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.644350:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ae25820c700) 00010000:00010000:3.0:1788568721.644354:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788568721.644358:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a142b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.644365:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a142b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788568721.644377:0:6714:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005840b154 reply state 00000000b6b426fc transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1432 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568721.644385:0:6714:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788568721.644418:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1424 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebf8 expref: 34 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.644433:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a1439 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebf8 expref: 33 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.644441:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ae2430ad300) 00010000:00010000:3.0:1788568721.644443:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788568721.644445:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429df000, rc 0) 00000100:00100000:3.0:1788568721.644672:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+34:10504:x1875449958415616:12345-192.168.206.4@tcp:101:bash.0 Request processed in 2685us (3134us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1788568721.644680:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 96 00010000:00010000:1.0:1788568721.651148:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1432 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.651192:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1432 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.651199:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1432 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.651205:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429dea00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568721.651210:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1432 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.651218:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1432 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.651242:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ae2430ada00) 00010000:00010000:1.0:1788568721.651245:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568721.651250:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1432 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.651257:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1432 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568721.652521:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568721.652605:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958415744 00000100:00100000:3.0:1788568721.652616:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958415744 00000100:00100000:3.0:1788568721.652675:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 34 00000100:00100000:3.0:1788568721.652686:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2363:x1875449958415744:12345-192.168.206.4@tcp:101:bash.0 00010000:00010000:3.0:1788568721.652715:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568721.652734:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000105ae995/0x41e82f464b6a1447 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bebff expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788568721.652760:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788568721.652779:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=356s v=(0 0) 00010000:00010000:3.0:1788568721.652783:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788568721.652792:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000105ae995/0x41e82f464b6a1447 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebff expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.652811:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000105ae995/0x41e82f464b6a1447 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebff expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.652825:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429dee00, rc 0) 00000100:00100000:3.0:1788568721.652886:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2363:x1875449958415744:12345-192.168.206.4@tcp:101:bash.0 Request processed in 201us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568721.652893:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 34 00000100:00100000:0.0:1788568721.656476:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568721.656553:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958415872 00000100:00100000:3.0:1788568721.656563:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958415872 00000100:00100000:3.0:1788568721.656616:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 35 00000100:00100000:3.0:1788568721.656625:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+6:10504:x1875449958415872:12345-192.168.206.4@tcp:101:bash.0 00010000:00010000:3.0:1788568721.656640:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568721.656656:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006839d0bc/0x41e82f464b6a144e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bec06 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.656684:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000105ae995/0x41e82f464b6a1447 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebff expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.656705:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788568721.656709:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788568721.656714:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006839d0bc/0x41e82f464b6a144e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec06 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.656745:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000105ae995/0x41e82f464b6a1447 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebff expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.656757:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000105ae995/0x41e82f464b6a1447 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebff expref: 7 pid: 6691 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568721.656770:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cd84e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6690:1875449976260864:192.168.206.4@tcp:104: 00000100:00100000:3.0:1788568721.656856:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae252512840 going to sleep for 11 seconds 00000100:00100000:3.0:1788568721.663807:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cd84e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6690:1875449976260864:192.168.206.4@tcp:104: 00010000:00010000:3.0:1788568721.663841:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006839d0bc/0x41e82f464b6a144e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec06 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.663863:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429df400, rc 0) 00000100:00100000:3.0:1788568721.663923:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+7:10504:x1875449958415872:12345-192.168.206.4@tcp:101:bash.0 Request processed in 7298us (7455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568721.663977:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 35 00000100:00100000:0.0:1788568721.669882:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568721.669995:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958416000 00000100:00100000:3.0:1788568721.670006:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958416000 00010000:00010000:3.0:1788568721.670048:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000105ae995/0x41e82f464b6a1447 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebff expref: 7 pid: 6691 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568721.670106:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 49 00000100:00100000:3.0:1788568721.670117:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25319d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+7:2364:x1875449958416000:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788568721.670146:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568721.670408:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000105ae995/0x41e82f464b6a1447 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebff expref: 7 pid: 6691 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.670423:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000105ae995/0x41e82f464b6a1447 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebff expref: 7 pid: 6691 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.670446:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000105ae995/0x41e82f464b6a1447 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebff expref: 7 pid: 6691 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.670463:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788568721.670467:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788568721.670475:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006839d0bc/0x41e82f464b6a144e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec06 expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.670485:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006839d0bc/0x41e82f464b6a144e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec06 expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.670529:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006839d0bc/0x41e82f464b6a144e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec06 expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568721.670545:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cd84e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5829:1875449976260992:192.168.206.4@tcp:105: 00000100:00100000:3.0:1788568721.670634:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae252512840 going to sleep for 11 seconds 00000100:00100000:3.0:1788568721.675259:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cd84e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5829:1875449976260992:192.168.206.4@tcp:105: 00010000:00010000:3.0:1788568721.675283:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788568721.675335:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25319d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2364:x1875449958416000:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 5219us (5463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568721.675347:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 49 00000100:00100000:1.0:1788568721.686711:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568721.687071:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958416256 00000100:00100000:3.0:1788568721.687081:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958416256 00000100:00100000:3.0:1788568721.687149:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 25 00000100:00100000:3.0:1788568721.687159:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277971500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+33:10504:x1875449958416256:12345-192.168.206.4@tcp:35:bash.0 00000100:00100000:3.0:1788568721.687513:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277971500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+34:10504:x1875449958416256:12345-192.168.206.4@tcp:35:bash.0 Request processed in 355us (811us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1788568721.687521:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 25 00000100:00100000:0.0:1788568721.940811:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568721.940954:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958416384 00000100:00100000:1.0:1788568721.940969:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958416384 00000100:00100000:1.0:1788568721.941043:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 97 00000100:00100000:1.0:1788568721.941054:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+34:10520:x1875449958416384:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:1.0:1788568721.941077:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568721.941099:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2cc00/0x41e82f464b6a1455 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bec0d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.941200:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a145c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.941214:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a145c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.941240:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a145c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568721.941273:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788568721.941276:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788568721.941294:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a145c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.941317:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2cc00/0x41e82f464b6a1455 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec0d expref: 36 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.941336:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a145c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec0d expref: 35 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.941344:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ae25820c700) 00010000:00010000:1.0:1788568721.941346:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788568721.941350:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2c200, rc 0) 00000100:00100000:1.0:1788568721.941557:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+35:10520:x1875449958416384:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 504us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568721.941565:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 97 00000100:00100000:1.0:1788568721.950616:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568721.950855:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958416640 00000100:00100000:3.0:1788568721.950870:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958416640 00000100:00100000:3.0:1788568721.951003:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 98 00000100:00100000:3.0:1788568721.951016:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+35:10520:x1875449958416640:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:3.0:1788568721.951053:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568721.951084:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1463 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bec14 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.951239:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a146a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.951393:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a146a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.951435:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a146a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788568721.951450:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788568721.951606:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1463 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec14 expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.951629:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a146a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec14 expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.951639:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ae2430ad300) 00010000:00010000:3.0:1788568721.951643:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788568721.951647:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429df200, rc 0) 00000100:00100000:3.0:1788568721.953415:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+37:10520:x1875449958416640:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 2389us (2801us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1788568721.953437:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 98 00000100:00100000:2.0:1788568721.961289:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568721.961522:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958416896 00000100:00100000:3.0:1788568721.961536:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958416896 00000100:00100000:3.0:1788568721.961612:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 99 00000100:00100000:3.0:1788568721.961624:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281b00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+37:10520:x1875449958416896:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:3.0:1788568721.961654:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568721.961749:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1478 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bec1b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.961905:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a147f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.961967:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a147f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.961983:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a147f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788568721.961999:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00000100:00100000:2.0:1788568721.963378:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568721.963468:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958417024 00000100:00100000:1.0:1788568721.963489:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958417024 00000100:00100000:1.0:1788568721.963562:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 6 00000100:00100000:1.0:1788568721.963576:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281b03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+39:2361:x1875449958417024:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788568721.963595:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788568721.963627:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a146a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec14 expref: 39 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568721.963647:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ae2430ad300) 00010000:00010000:1.0:1788568721.963654:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788568721.963833:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281b03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+38:2361:x1875449958417024:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 260us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568721.963842:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 6 00010000:00010000:3.0:1788568721.965405:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1478 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec1b expref: 39 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.966135:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a147f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec1b expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.966150:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ae2430ad300) 00010000:00010000:3.0:1788568721.966153:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788568721.966157:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429dfe00, rc 0) 00000100:00100000:3.0:1788568721.966317:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281b00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+38:10520:x1875449958416896:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 4692us (5039us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1788568721.966328:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 99 00000100:00100000:2.0:1788568721.983915:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568721.984150:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958417152 00000100:00100000:3.0:1788568721.984165:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958417152 00000100:00100000:3.0:1788568721.984241:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 36 00000100:00100000:3.0:1788568721.984254:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281b01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2363:x1875449958417152:12345-192.168.206.4@tcp:1:lfs.0 00010000:00010000:3.0:1788568721.984317:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016a7f031/0x41e82f464b6a148d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.984343:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006839d0bc/0x41e82f464b6a144e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec06 expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.984371:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788568721.984376:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788568721.984382:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016a7f031/0x41e82f464b6a148d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.984428:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006839d0bc/0x41e82f464b6a144e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec06 expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568721.984459:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006839d0bc/0x41e82f464b6a144e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec06 expref: 6 pid: 6690 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568721.984477:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cd87480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1875449976261120:192.168.206.4@tcp:104: 00000100:00100000:3.0:1788568721.984601:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae277d98f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788568721.996353:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cd87480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1875449976261120:192.168.206.4@tcp:104: 00010000:00010000:3.0:1788568721.996396:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000016a7f031/0x41e82f464b6a148d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568722.000650:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568722.000782:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958417280 00000100:00100000:3.0:1788568722.000797:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958417280 00002000:00100000:3.0:1788568722.000883:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9ae277973b80 x1875449958417280/t0(0) o4->27f83c0c-e36b-48ce-9485-80051fd252dc@192.168.206.4@tcp:158/0 lens 504/0 e 0 to 0 dl 1788568733 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788568722.000894:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae277973b80 with x1875449958417280 ext(0->8) 00010000:00010000:3.0:1788568722.000904:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006839d0bc/0x41e82f464b6a144e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec06 expref: 7 pid: 6690 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.000985:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006839d0bc/0x41e82f464b6a144e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec06 expref: 7 pid: 6690 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788568722.000992:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ae277973b80 00000100:00100000:3.0:1788568722.001023:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 1 00000100:00100000:3.0:1788568722.001034:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277973b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+7:2364:x1875449958417280:12345-192.168.206.4@tcp:4:lfs.0 00000100:00100000:3.0:1788568722.001635:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277973b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+9:2364:x1875449958417280:12345-192.168.206.4@tcp:4:lfs.0 Request processed in 599us (997us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788568722.001644:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 1 00002000:00100000:3.0:1788568722.001652:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9ae277973b80 x1875449958417280/t4294967302(0) o4->27f83c0c-e36b-48ce-9485-80051fd252dc@192.168.206.4@tcp:158/0 lens 504/448 e 0 to 0 dl 1788568733 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788568722.001661:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae277973b80 with x1875449958417280 ext(0->8) 00010000:00010000:3.0:1788568722.001667:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006839d0bc/0x41e82f464b6a144e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec06 expref: 9 pid: 6690 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.001681:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006839d0bc/0x41e82f464b6a144e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec06 expref: 9 pid: 6690 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788568722.001688:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ae277973b80 00000100:00080000:0.0:1788568722.001889:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788568722.010600:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568722.010881:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958417408 00000100:00100000:1.0:1788568722.010894:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958417408 00010000:00010000:1.0:1788568722.010993:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006839d0bc/0x41e82f464b6a144e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec06 expref: 9 pid: 6690 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568722.011466:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 50 00000100:00100000:0.0:1788568722.011482:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281b01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+9:2361:x1875449958417408:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788568722.011502:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788568722.011528:0:5827:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788568722.011546:0:5827:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788568720 00002000:00010000:0.0:1788568722.011548:0:5827:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788568720 00002000:00010000:0.0:1788568722.011550:0:5827:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788568720 00010000:00010000:0.0:1788568722.011559:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006839d0bc/0x41e82f464b6a144e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec06 expref: 9 pid: 6690 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568722.011575:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006839d0bc/0x41e82f464b6a144e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec06 expref: 9 pid: 6690 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568722.011601:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006839d0bc/0x41e82f464b6a144e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec06 expref: 9 pid: 6690 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568722.011624:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788568722.011630:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788568722.011637:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000016a7f031/0x41e82f464b6a148d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568722.011648:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016a7f031/0x41e82f464b6a148d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568722.011694:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788568722.011766:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281b01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+8:2361:x1875449958417408:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 290us (1181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568722.011775:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 50 00010000:00010000:2.0:1788568722.012392:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000016a7f031/0x41e82f464b6a148d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.012407:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016a7f031/0x41e82f464b6a148d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.012455:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016a7f031/0x41e82f464b6a148d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.012465:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016a7f031/0x41e82f464b6a148d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.012486:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016a7f031/0x41e82f464b6a148d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.012494:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429dea00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:2.0:1788568722.012499:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016a7f031/0x41e82f464b6a148d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.012510:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016a7f031/0x41e82f464b6a148d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.012526:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016a7f031/0x41e82f464b6a148d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.012533:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016a7f031/0x41e82f464b6a148d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568722.012625:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281b01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+7:2363:x1875449958417152:12345-192.168.206.4@tcp:1:lfs.0 Request processed in 28372us (28725us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568722.012636:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 36 00000100:00100000:2.0:1788568722.024350:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568722.024456:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958417664 00000100:00100000:3.0:1788568722.024470:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958417664 00000100:00100000:3.0:1788568722.024539:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 26 00000100:00100000:3.0:1788568722.024551:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24926fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+38:10520:x1875449958417664:12345-192.168.206.4@tcp:35:lfs.0 00000004:00010000:3.0:1788568722.024656:0:5845:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a147f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec1b expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788568722.025296:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1788568722.025360:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1788568722.025795:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1788568722.025860:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1494 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.025879:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a1439 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebf8 expref: 42 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.025889:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1494 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.026138:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a1439 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebf8 expref: 42 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.026159:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a1439 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebf8 expref: 42 pid: 6714 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568722.026177:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cd87480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5845:1875449976261248:192.168.206.4@tcp:104: 00000100:00100000:3.0:1788568722.026342:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae277d98540 going to sleep for 11 seconds 00000100:00100000:1.0:1788568722.037506:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568722.038161:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958417792 00000100:00100000:2.0:1788568722.038175:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958417792 00010000:00010000:2.0:1788568722.038242:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a1439 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebf8 expref: 43 pid: 6714 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568722.038323:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 51 00000100:00100000:2.0:1788568722.038336:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2530f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+43:2364:x1875449958417792:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788568722.038356:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568722.038365:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a1439 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebf8 expref: 43 pid: 6714 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.038381:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a1439 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebf8 expref: 43 pid: 6714 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.038410:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ae2430ad300) 00010000:00010000:2.0:1788568722.038416:0:6705:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1494 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.038429:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1494 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.038438:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1494 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.038463:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568722.038539:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2530f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+43:2364:x1875449958417792:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 204us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568722.038547:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 51 00010000:00010000:3.0:1788568722.040191:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a1439 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebf8 expref: 42 pid: 6714 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568722.040227:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cd87480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5845:1875449976261248:192.168.206.4@tcp:104: 00010000:00010000:3.0:1788568722.040260:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1494 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.040290:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1494 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.040297:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1494 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788568722.040984:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1788568722.041288:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1788568722.041426:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2526d6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1875449976261376:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788568722.041542:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568722.041598:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27bcfbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788568722.041978:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976261376 00000100:00100000:2.0:1788568722.041989:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976261376 00000100:00100000:2.0:1788568722.042071:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788568722.042084:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5845:x1875449976261376:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788568722.042204:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5845:x1875449976261376:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 123us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568722.042212:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788568722.042396:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2526d6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1875449976261376:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788568722.043205:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1788568722.043312:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cd87480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1875449976261504:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788568722.043370:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568722.043408:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27bcfbb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788568722.043563:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976261504 00000100:00100000:1.0:1788568722.043571:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976261504 00000100:00100000:1.0:1788568722.043613:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788568722.043624:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cd85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5845:x1875449976261504:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788568722.043847:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cd85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5845:x1875449976261504:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 224us (475us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788568722.043855:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788568722.044185:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cd87480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1875449976261504:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788568722.044273:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1788568722.044326:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1494 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.044339:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1494 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.044348:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1494 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.044354:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429dee00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568722.044360:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1494 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.044368:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1494 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.044408:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ae2430ad300) 00010000:00010000:3.0:1788568722.044411:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788568722.044417:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1494 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.044425:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a1494 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788568722.044676:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1788568722.045271:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788568722.047815:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1788568722.047846:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 356455918612ns, next at 357455912854ns, rc = 0 00000001:00080000:0.0:1788568722.047867:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1788568722.047993:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ae2430ad300) 00010000:00010000:0.0:1788568722.047999:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788568722.048014:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a147f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec1b expref: 46 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568722.048198:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24926fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+45:10520:x1875449958417664:12345-192.168.206.4@tcp:35:lfs.0 Request processed in 23648us (23861us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1788568722.048210:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 26 00000020:00080000:0.0:1788568722.048217:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788568722.060459:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568722.060683:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958417920 00000100:00100000:3.0:1788568722.060697:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958417920 00000100:00100000:3.0:1788568722.060776:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 100 00000100:00100000:3.0:1788568722.060789:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2530f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+45:10520:x1875449958417920:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:3.0:1788568722.060825:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568722.060857:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a149b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bec22 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.060980:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a149b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec22 expref: 46 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.061000:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a149b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec22 expref: 46 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.061185:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ae2430ad200) 00010000:00010000:3.0:1788568722.061190:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788568722.061195:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429dee00, rc 0) 00000100:00100000:3.0:1788568722.061291:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2530f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+46:10520:x1875449958417920:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 504us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568722.061299:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 100 00000100:00100000:1.0:1788568722.070518:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568722.070814:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958418176 00000100:00100000:2.0:1788568722.070828:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958418176 00000100:00100000:2.0:1788568722.070961:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 27 00000100:00100000:2.0:1788568722.070974:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2530f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+46:10520:x1875449958418176:12345-192.168.206.4@tcp:35:lfs.0 00000100:00100000:2.0:1788568722.071306:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2530f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+47:10520:x1875449958418176:12345-192.168.206.4@tcp:35:lfs.0 Request processed in 334us (802us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1788568722.071316:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 27 00000100:00100000:2.0:1788568722.219238:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568722.219482:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958418304 00000100:00100000:1.0:1788568722.219495:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958418304 00000100:00100000:1.0:1788568722.219629:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 101 00000100:00100000:1.0:1788568722.219642:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281b00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+47:10530:x1875449958418304:12345-192.168.206.4@tcp:34:lfs.0 00010000:00010000:1.0:1788568722.219753:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a14a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.219774:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a14a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.219789:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a14a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.219806:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a14a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.219814:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a14a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.219821:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a14a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.219964:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a14b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.219974:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a14b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.219981:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a14b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788568722.220066:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a14b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.220082:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a14a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.220089:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a14a2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.220097:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a14a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.220103:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2d200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568722.220108:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a14a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.220117:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a14a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.220131:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ae25820c700) 00010000:00010000:1.0:1788568722.220134:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568722.220139:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a14a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.220145:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a14a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.220161:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a14a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.220167:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a14a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.220191:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a14a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.220197:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2da00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568722.220200:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a14a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.220208:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a14a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.220217:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ae25820cb00) 00010000:00010000:1.0:1788568722.220230:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568722.220234:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a14a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.220240:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a14a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.220457:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a14b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.220466:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a14b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.220472:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a14b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.220477:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2c000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568722.220480:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a14b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.220498:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a14b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.220507:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ae2430ad200) 00010000:00010000:1.0:1788568722.220509:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568722.220512:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a14b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.220518:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a14b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568722.220630:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281b00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+47:10530:x1875449958418304:12345-192.168.206.4@tcp:34:lfs.0 Request processed in 987us (1413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568722.220638:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 101 00000100:00100000:1.0:1788568722.292553:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568722.292660:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958418560 00000100:00100000:3.0:1788568722.292673:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958418560 00000100:00100000:3.0:1788568722.292749:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 102 00000100:00100000:3.0:1788568722.292761:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2530f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+47:10533:x1875449958418560:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:3.0:1788568722.292787:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568722.292814:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a14b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bec29 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.292907:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a14be lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.292965:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a14be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.292981:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a14be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.293001:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a14c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.293009:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a14c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.293016:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a14c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.293169:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a14cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.293178:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a14cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.293210:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a14cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788568722.293233:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788568722.293731:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a14be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.293743:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a14be lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.293750:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a14be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.293757:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429de800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568722.293763:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a14be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.293771:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a14be lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.293786:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ae25820c700) 00010000:00010000:3.0:1788568722.293789:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788568722.293794:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a14be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.293800:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a14be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.293816:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a14c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.293822:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a14c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.293836:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a14c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.293841:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429dfe00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568722.293844:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a14c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.293850:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a14c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.293857:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ae2430adc00) 00010000:00010000:3.0:1788568722.293860:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788568722.293863:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a14c5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.293869:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a14c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.293920:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a14b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec29 expref: 50 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.293977:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a14cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec29 expref: 49 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.293985:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ae2430ad200) 00010000:00010000:3.0:1788568722.293987:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788568722.293990:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429df400, rc 0) 00000100:00100000:3.0:1788568722.294136:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2530f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+49:10533:x1875449958418560:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 1375us (1594us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1788568722.294156:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 102 00000100:00100000:2.0:1788568722.302776:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568722.302879:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958418688 00000100:00100000:3.0:1788568722.302893:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958418688 00000100:00100000:3.0:1788568722.303238:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 103 00000100:00100000:3.0:1788568722.304989:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281b02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+49:10533:x1875449958418688:12345-192.168.206.4@tcp:54:lfs.0 00010000:00010000:3.0:1788568722.305592:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a14da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.305621:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a14da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.305640:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a14da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.305987:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a14da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.305999:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a14da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.306007:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a14da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.306014:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429df000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568722.306019:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a14da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.306029:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a14da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.306045:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ae2430ad200) 00010000:00010000:3.0:1788568722.306068:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788568722.306076:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a14da lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.306082:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a14da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568722.306275:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281b02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+49:10533:x1875449958418688:12345-192.168.206.4@tcp:54:lfs.0 Request processed in 3021us (3507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568722.306287:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 103 00000100:00100000:2.0:1788568722.310707:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568722.310866:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958418944 00000100:00100000:0.0:1788568722.310880:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958418944 00000100:00100000:0.0:1788568722.310989:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 28 00000100:00100000:0.0:1788568722.311001:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281b03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+49:10533:x1875449958418944:12345-192.168.206.4@tcp:35:lfs.0 00000100:00100000:0.0:1788568722.311617:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281b03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+50:10533:x1875449958418944:12345-192.168.206.4@tcp:35:lfs.0 Request processed in 615us (923us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1788568722.311628:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 28 00000100:00100000:1.0:1788568722.472482:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568722.476319:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958419200 00000100:00100000:3.0:1788568722.476341:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958419200 00000100:00100000:3.0:1788568722.476511:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 104 00000100:00100000:3.0:1788568722.476536:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2530f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+50:10543:x1875449958419200:12345-192.168.206.4@tcp:101:bash.0 00010000:00010000:3.0:1788568722.476572:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568722.476576:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788568722.476613:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a145c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec0d expref: 50 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.476637:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ae25820c700) 00010000:00010000:3.0:1788568722.476643:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788568722.476660:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a14e1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bec30 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.476799:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a14e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.476815:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a14e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.476852:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a14e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788568722.476866:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788568722.477123:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a14e1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec30 expref: 52 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.477140:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a14e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec30 expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.477147:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ae2430ad200) 00010000:00010000:3.0:1788568722.477151:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788568722.477153:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429dfe00, rc 0) 00000100:00100000:3.0:1788568722.477260:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2530f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+51:10543:x1875449958419200:12345-192.168.206.4@tcp:101:bash.0 Request processed in 736us (4791us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1788568722.477269:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 104 00000100:00100000:1.0:1788568722.486273:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568722.486651:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958419456 00000100:00100000:0.0:1788568722.486667:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958419456 00000100:00100000:0.0:1788568722.486756:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 105 00000100:00100000:0.0:1788568722.486769:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2530f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+51:10543:x1875449958419456:12345-192.168.206.4@tcp:36:bash.0 00010000:00010000:0.0:1788568722.486882:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788568722.486918:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a14e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec30 expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568722.487651:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a14cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec29 expref: 50 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568722.487666:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ae2430ad200) 00010000:00010000:0.0:1788568722.487673:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788568722.488265:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a14f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568722.488288:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a14f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568722.488302:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a14f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788568722.488376:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1788568722.488409:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006008a425 reply state 000000000c9a65f1 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a14f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568722.488420:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788568722.489147:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2530f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+52:10543:x1875449958419456:12345-192.168.206.4@tcp:36:bash.0 Request processed in 2372us (2879us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1788568722.489159:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 105 00000020:00080000:0.0:1788568722.489166:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788568722.491316:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a14f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.491336:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a14f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.491344:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a14f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.491350:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaa400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568722.491356:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a14f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.491385:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a14f6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.491405:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ae2430ad200) 00010000:00010000:1.0:1788568722.491408:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568722.491413:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a14f6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.491420:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a14f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568722.492630:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568722.492722:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958419584 00000100:00100000:3.0:1788568722.492737:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958419584 00000100:00100000:3.0:1788568722.492802:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 106 00000100:00100000:3.0:1788568722.492814:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2530f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+51:10543:x1875449958419584:12345-192.168.206.4@tcp:101:bash.0 00010000:00010000:3.0:1788568722.492845:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568722.492870:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a14fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bec37 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.493010:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1504 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.493446:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1504 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.493459:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1504 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788568722.493495:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788568722.493499:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788568722.493534:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1504 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.493569:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a14fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec37 expref: 53 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.493590:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1504 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec37 expref: 52 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.493599:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ae2430ad200) 00010000:00010000:3.0:1788568722.493602:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788568722.493606:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429de800, rc 0) 00000100:00100000:3.0:1788568722.493682:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2530f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+52:10543:x1875449958419584:12345-192.168.206.4@tcp:101:bash.0 Request processed in 869us (1162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568722.493691:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 106 00000100:00100000:3.0:1788568722.506173:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568722.506408:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958419840 00000100:00100000:2.0:1788568722.506421:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958419840 00000100:00100000:2.0:1788568722.506485:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 29 00000100:00100000:2.0:1788568722.506495:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cd84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+52:10543:x1875449958419840:12345-192.168.206.4@tcp:35:bash.0 00000100:00100000:2.0:1788568722.507593:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cd84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+53:10543:x1875449958419840:12345-192.168.206.4@tcp:35:bash.0 Request processed in 1090us (1427us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1788568722.507605:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 29 00000100:00100000:1.0:1788568722.612996:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568722.613757:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958419968 00000100:00100000:3.0:1788568722.613772:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958419968 00000100:00100000:3.0:1788568722.613854:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 107 00000100:00100000:3.0:1788568722.613867:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+53:10549:x1875449958419968:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:3.0:1788568722.613981:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568722.614029:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a150b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bec3e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.614137:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1512 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.614158:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1512 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.614176:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1512 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788568722.614232:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788568722.614236:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788568722.614262:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1512 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.614306:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a150b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec3e expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.614335:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1512 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec3e expref: 54 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.614346:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ae25820c700) 00010000:00010000:3.0:1788568722.614349:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788568722.614355:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429dea00, rc 0) 00000100:00100000:3.0:1788568722.614445:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+54:10549:x1875449958419968:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 580us (1464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568722.614453:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 107 00010000:00010000:0.0:1788568722.615706:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568722.627811:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568722.629009:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958420096 00000100:00100000:3.0:1788568722.629043:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958420096 00000100:00100000:3.0:1788568722.629136:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 108 00000100:00100000:3.0:1788568722.629149:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+54:10549:x1875449958420096:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:3.0:1788568722.629176:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568722.629206:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a1519 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bec45 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.629473:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1520 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.629494:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1520 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.629509:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1520 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.635877:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1527 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.635912:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.635944:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.636275:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a152e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.636287:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a152e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.636433:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a152e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788568722.636487:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788568722.636491:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788568722.636516:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a152e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.636784:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a152e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.636795:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1520 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.636803:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1520 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.636810:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1520 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.636817:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429df200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568722.636822:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1520 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.636831:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1520 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.636861:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ae25820c700) 00010000:00010000:2.0:1788568722.636864:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788568722.636870:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1520 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.636878:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1520 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.636896:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.636903:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1527 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.636909:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1527 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.636915:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7aa00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568722.636918:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1527 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.636924:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1527 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.636994:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ae2430adc00) 00010000:00010000:2.0:1788568722.636996:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788568722.637000:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1527 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.637006:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1527 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.637866:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a1519 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec45 expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.637885:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a152e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec45 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.637894:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ae2430ad200) 00010000:00010000:2.0:1788568722.637895:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788568722.637899:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7b200, rc 0) 00000100:00100000:2.0:1788568722.638816:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+55:10549:x1875449958420096:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 9658us (11010us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568722.638828:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 108 00000100:00100000:2.0:1788568722.651651:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568722.651757:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958420352 00000100:00100000:0.0:1788568722.651768:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958420352 00000100:00100000:0.0:1788568722.651841:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 109 00000100:00100000:0.0:1788568722.651851:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+55:10549:x1875449958420352:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:0.0:1788568722.651871:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568722.651890:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1535 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bec4c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568722.652029:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a153c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568722.652045:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1504 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec37 expref: 56 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568722.652054:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a152e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec45 expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568722.652064:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a153c lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568722.652096:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a152e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec45 expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568722.652110:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a152e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec45 expref: 56 pid: 5843 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568722.652124:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2526d5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875449976261632:192.168.206.4@tcp:104: 00010000:00010000:0.0:1788568722.652378:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1504 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec37 expref: 56 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568722.652400:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1504 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec37 expref: 56 pid: 6714 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568722.652410:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2526d4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875449976261760:192.168.206.4@tcp:104: 00000100:00100000:0.0:1788568722.652438:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae250ae46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788568722.655594:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568722.655693:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958420480 00000100:00100000:2.0:1788568722.655704:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958420480 00010000:00010000:2.0:1788568722.655744:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a152e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec45 expref: 57 pid: 5843 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568722.655790:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 52 00000100:00100000:2.0:1788568722.655800:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cd86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+57:2363:x1875449958420480:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788568722.655814:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568722.655821:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a152e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec45 expref: 57 pid: 5843 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.655834:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a152e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec45 expref: 57 pid: 5843 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.655871:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ae2430ad200) 00010000:00010000:2.0:1788568722.655876:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a153c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.655884:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a153c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.655889:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568722.655975:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cd86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+57:2363:x1875449958420480:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 176us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568722.655982:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 52 00010000:00010000:0.0:1788568722.656472:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a152e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec45 expref: 56 pid: 5843 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568722.656490:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2526d5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875449976261632:192.168.206.4@tcp:104: 00000100:00100000:3.0:1788568722.659512:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568722.659661:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2526d4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875449976261760:192.168.206.4@tcp:104: 00010000:00010000:0.0:1788568722.659696:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a153c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568722.659965:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958420608 00000100:00100000:2.0:1788568722.659972:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958420608 00010000:00010000:2.0:1788568722.660006:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1504 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec37 expref: 56 pid: 6714 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568722.660041:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 53 00000100:00100000:2.0:1788568722.660052:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cd87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+56:2363:x1875449958420608:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788568722.660068:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568722.660075:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1504 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec37 expref: 56 pid: 6714 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.660088:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1504 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec37 expref: 56 pid: 6714 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.660109:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1504 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec37 expref: 56 pid: 6714 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.660390:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ae2430ad200) 00010000:00010000:2.0:1788568722.660395:0:6705:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a153c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.660404:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a153c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.660412:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a153c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.660441:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568722.660498:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cd87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+55:2363:x1875449958420608:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 448us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568722.660507:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 53 00010000:00010000:0.0:1788568722.660560:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a153c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568722.660569:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a153c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788568722.660586:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788568722.660730:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1535 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec4c expref: 56 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568722.660747:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a153c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec4c expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568722.660767:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ae2430ad200) 00010000:00010000:0.0:1788568722.660770:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788568722.660773:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae27feaa400, rc 0) 00000100:00100000:0.0:1788568722.660799:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+55:10549:x1875449958420352:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 8950us (9157us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1788568722.660805:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 109 00000100:00100000:1.0:1788568722.666703:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568722.666768:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958420864 00000100:00100000:2.0:1788568722.666778:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958420864 00000100:00100000:2.0:1788568722.666843:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 7 00000100:00100000:2.0:1788568722.666853:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b680000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+55:10549:x1875449958420864:12345-192.168.206.4@tcp:103:lfs.0 00010000:00010000:2.0:1788568722.666868:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568722.666890:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a149b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec22 expref: 55 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.666909:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ae2430ad200) 00010000:00010000:2.0:1788568722.666913:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568722.666984:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b680000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+54:10549:x1875449958420864:12345-192.168.206.4@tcp:103:lfs.0 Request processed in 132us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568722.666991:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 7 00000100:00100000:3.0:1788568722.674266:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568722.674366:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958420992 00000100:00100000:1.0:1788568722.674376:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958420992 00000100:00100000:1.0:1788568722.674432:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 110 00000100:00100000:1.0:1788568722.674441:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cd84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+54:10549:x1875449958420992:12345-192.168.206.4@tcp:58:lfs.0 00010000:00010000:1.0:1788568722.674525:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a154a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.674541:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a154a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.674554:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a154a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788568722.674730:0:6714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1788568722.674821:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cd84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+54:10549:x1875449958420992:12345-192.168.206.4@tcp:58:lfs.0 Request processed in 379us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568722.674840:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 110 00000100:00100000:3.0:1788568722.692295:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568722.692394:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958421120 00000100:00100000:1.0:1788568722.692403:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958421120 00000100:00100000:1.0:1788568722.692458:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 111 00000100:00100000:1.0:1788568722.692468:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cd86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+54:10549:x1875449958421120:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:1.0:1788568722.692486:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568722.692505:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a1551 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bec53 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.692559:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a154a lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.692570:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a1551 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec53 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.692588:0:5844:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a154a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.692600:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a1551 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec53 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.692613:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ae2430ad200) 00010000:00010000:1.0:1788568722.692617:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788568722.692621:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a1551 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec53 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.692628:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2da00, rc 0) 00000100:00100000:1.0:1788568722.692684:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cd86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+55:10549:x1875449958421120:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 216us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568722.692705:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 111 00000040:00080000:1.0:1788568722.743340:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788568722.743349:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788568722.743404:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1788568722.743411:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788568722.743528:0:11686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b682a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11686:1875449976261888:192.168.206.4@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788568722.743680:0:11686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2525123c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788568722.750462:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568722.751187:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958421248 00000100:00100000:2.0:1788568722.751197:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958421248 00000100:00100000:2.0:1788568722.751270:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 112 00000100:00100000:2.0:1788568722.751281:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cd84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+56:10550:x1875449958421248:12345-192.168.206.4@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788568722.751314:0:6714:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788568722.751424:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cd84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+56:10550:x1875449958421248:12345-192.168.206.4@tcp:53:lhsmtool_posix.0 Request processed in 145us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568722.751431:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 112 00000100:00100000:1.0:1788568722.755612:0:11686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b682a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11686:1875449976261888:192.168.206.4@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788568722.760421:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568722.760585:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958421376 00000100:00100000:1.0:1788568722.760595:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958421376 00000100:00100000:1.0:1788568722.760658:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 113 00000100:00100000:1.0:1788568722.760668:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cd84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+55:10550:x1875449958421376:12345-192.168.206.4@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788568722.760754:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a1558 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.760771:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a1558 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.760783:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a1558 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.760836:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a155f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.760844:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a155f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.760852:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a155f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.760891:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1566 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.760900:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1566 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.760906:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1566 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568722.760995:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788568722.761000:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788568722.761013:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1566 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.761023:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a1558 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.761030:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a1558 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.761038:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a1558 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.761043:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2c000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568722.761047:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a1558 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.761054:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a1558 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.761064:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ae25820cd00) 00010000:00010000:1.0:1788568722.761073:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568722.761079:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a1558 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.761085:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a1558 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.761099:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a155f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.761104:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a155f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.761109:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a155f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.761114:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2d800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568722.761116:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a155f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.761120:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a155f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.761127:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9ae25820cb00) 00010000:00010000:1.0:1788568722.761129:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568722.761132:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a155f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.761138:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a155f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.761151:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1566 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.761162:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1566 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.761167:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1566 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.761172:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2ca00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568722.761175:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1566 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.761181:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1566 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.761189:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ae2430ad200) 00010000:00010000:1.0:1788568722.761191:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568722.761194:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1566 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.761199:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1566 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568722.761298:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cd84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+55:10550:x1875449958421376:12345-192.168.206.4@tcp:34:lhsmtool_posix.0 Request processed in 630us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568722.761306:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 113 00000100:00100000:0.0:1788568722.768103:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568722.768171:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958421632 00000100:00100000:2.0:1788568722.768181:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958421632 00000100:00100000:2.0:1788568722.768248:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 114 00000100:00100000:2.0:1788568722.768258:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+55:10550:x1875449958421632:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788568722.768277:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568722.768297:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a156d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bec5a expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.768385:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1574 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.768400:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1574 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.768411:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1574 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788568722.768422:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788568722.768510:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1574 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.768518:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1574 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.768536:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1574 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.768542:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7b200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568722.768545:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1574 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.768553:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1574 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.768565:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ae2430ad200) 00010000:00010000:2.0:1788568722.768568:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788568722.768572:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1574 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.768578:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1574 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.768616:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a156d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec5a expref: 57 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.768625:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ae25820cd00) 00010000:00010000:2.0:1788568722.768627:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788568722.768630:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a156d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec5a expref: 57 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.768637:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7aa00, rc 0) 00000100:00100000:2.0:1788568722.768698:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+56:10550:x1875449958421632:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 441us (604us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1788568722.768714:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 114 00000100:00100000:3.0:1788568722.776293:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568722.777988:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958421760 00000100:00100000:1.0:1788568722.778002:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958421760 00000100:00100000:1.0:1788568722.778060:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 115 00000100:00100000:0.0:1788568722.778094:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cd85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+56:10550:x1875449958421760:12345-192.168.206.4@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788568722.778130:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788568722.778419:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cd85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+56:10550:x1875449958421760:12345-192.168.206.4@tcp:53:lhsmtool_posix.0 Request processed in 348us (2134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568722.778427:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 115 00000100:00100000:0.0:1788568722.794380:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568722.795873:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958422016 00000100:00100000:2.0:1788568722.795885:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958422016 00000100:00100000:2.0:1788568722.796033:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 116 00000100:00100000:2.0:1788568722.796046:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+56:10550:x1875449958422016:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788568722.796067:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568722.796070:0:6714:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788568722.796097:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1512 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec3e expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.796118:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ae25820c700) 00010000:00010000:2.0:1788568722.796123:0:6714:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788568722.796136:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1582 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bec61 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788568722.796585:0:6714:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788568722.796766:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1589 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.796780:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1589 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.796791:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1589 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.796840:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1582 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec61 expref: 58 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.796871:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1589 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec61 expref: 57 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.796879:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ae255fb9500) 00010000:00010000:2.0:1788568722.796882:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788568722.796885:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7b200, rc 0) 00000100:00100000:2.0:1788568722.797006:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+57:10550:x1875449958422016:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 962us (2634us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1788568722.797014:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 116 00000100:00100000:0.0:1788568722.809805:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568722.809881:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958422272 00000100:00100000:1.0:1788568722.809891:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958422272 00000100:00100000:1.0:1788568722.809974:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 117 00000100:00100000:1.0:1788568722.809998:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+57:10550:x1875449958422272:12345-192.168.206.4@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788568722.810053:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788568722.810077:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1589 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec61 expref: 57 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.810095:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ae255fb9500) 00010000:00010000:1.0:1788568722.810106:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788568722.810126:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1597 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.810140:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1597 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.810150:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1597 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.810161:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a159e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x697db18 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.810181:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a159e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x697db18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.810188:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a159e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x697db18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.810419:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1597 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.810428:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1597 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.810446:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1597 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.810452:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2d800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568722.810457:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1597 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.810465:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1597 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.810475:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ae25820c700) 00010000:00010000:1.0:1788568722.810477:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568722.810481:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1597 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.810487:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1597 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.810497:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a159e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x697db18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.810503:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a159e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x697db18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.810508:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a159e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x697db18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.810514:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2c000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568722.810517:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a159e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x697db18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.810533:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a159e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x697db18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.810541:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x697db18 (ffff9ae25820cb00) 00010000:00010000:1.0:1788568722.810544:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568722.810547:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a159e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x697db18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.810553:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a159e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x697db18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568722.811345:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+56:10550:x1875449958422272:12345-192.168.206.4@tcp:36:lhsmtool_posix.0 Request processed in 1344us (1543us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788568722.811354:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 117 00000100:00100000:3.0:1788568722.818238:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568722.818319:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958422400 00000100:00100000:2.0:1788568722.818328:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958422400 00000100:00100000:2.0:1788568722.818389:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 118 00000100:00100000:2.0:1788568722.818399:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cd87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+56:10550:x1875449958422400:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788568722.818418:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568722.818441:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a15a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bec68 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.818477:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a15ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.818491:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a15ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.818504:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a15ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.818603:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a15a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec68 expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.818629:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a15ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec68 expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.818638:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ae255fb9e00) 00010000:00010000:2.0:1788568722.818641:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788568722.818645:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7bc00, rc 0) 00000100:00100000:2.0:1788568722.824396:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cd87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+57:10550:x1875449958422400:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 5813us (5995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568722.824410:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 118 00000100:00100000:1.0:1788568722.833476:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568722.833767:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958422656 00000100:00100000:0.0:1788568722.833777:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958422656 00000100:00100000:0.0:1788568722.833833:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 119 00000100:00100000:0.0:1788568722.833843:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+57:10550:x1875449958422656:12345-192.168.206.4@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788568722.833917:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a15b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568722.834105:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a15b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568722.834118:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a15b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788568722.834513:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:0.0:1788568722.834522:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 357242594720ns, next at 358242592344ns, rc = 0 00000004:00010000:0.0:1788568722.834612:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000562d4063 reply state 00000000dc6d5270 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a15b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568722.834620:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788568722.834764:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+59:10550:x1875449958422656:12345-192.168.206.4@tcp:36:lhsmtool_posix.0 Request processed in 921us (1297us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1788568722.834772:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 119 00000100:00100000:3.0:1788568722.843508:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568722.843715:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958422784 00000100:00100000:0.0:1788568722.843725:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958422784 00000100:00100000:0.0:1788568722.843778:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 120 00000100:00100000:0.0:1788568722.843789:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cd86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+59:10550:x1875449958422784:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788568722.843810:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568722.843829:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a15ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bec6f expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568722.843890:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a15ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec6f expref: 60 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568722.843907:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a15ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec6f expref: 60 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568722.843978:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ae255fb9e00) 00010000:00010000:0.0:1788568722.843981:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788568722.843985:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae27feaa200, rc 0) 00000100:00100000:0.0:1788568722.844055:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cd86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+60:10550:x1875449958422784:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 265us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568722.844063:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 120 00010000:00010000:1.0:1788568722.848386:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a15b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.848403:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a15b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.848411:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a15b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.848417:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feabe00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568722.848422:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a15b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.848429:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a15b3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.848468:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ae255fb9e00) 00010000:00010000:1.0:1788568722.848471:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788568722.848475:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a15b3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568722.848482:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a15b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568722.855562:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568722.855753:0:8111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958422912 00000100:00100000:2.0:1788568722.855764:0:8111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958422912 00000100:00100000:2.0:1788568722.855876:0:8111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 37 00000100:00100000:2.0:1788568722.855885:0:8111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cd85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+8:2364:x1875449958422912:12345-192.168.206.4@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788568722.856159:0:8111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cd85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+9:2364:x1875449958422912:12345-192.168.206.4@tcp:2:lhsmtool_posix.0 Request processed in 274us (606us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788568722.856177:0:8111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 37 00000100:00100000:2.0:1788568722.861456:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568722.861686:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958423168 00000100:00100000:3.0:1788568722.861695:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958423168 00000100:00100000:3.0:1788568722.861749:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 30 00000100:00100000:3.0:1788568722.861771:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281b02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+59:10550:x1875449958423168:12345-192.168.206.4@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788568722.863426:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281b02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+60:10550:x1875449958423168:12345-192.168.206.4@tcp:35:lhsmtool_posix.0 Request processed in 1648us (1970us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1788568722.863438:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 30 00000100:00080000:0.0:1788568722.864496:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788568722.872986:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568722.873071:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958423424 00000100:00100000:0.0:1788568722.873080:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958423424 00000100:00100000:0.0:1788568722.873147:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 121 00000100:00100000:0.0:1788568722.873157:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277ac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+60:10550:x1875449958423424:12345-192.168.206.4@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788568722.873534:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277ac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+60:10550:x1875449958423424:12345-192.168.206.4@tcp:57:lhsmtool_posix.0 Request processed in 377us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568722.873542:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 121 00000100:00100000:1.0:1788568722.890392:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568722.890491:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958423552 00000100:00100000:0.0:1788568722.890500:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958423552 00000100:00100000:0.0:1788568722.890556:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 122 00000100:00100000:0.0:1788568722.890566:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fec7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+60:10550:x1875449958423552:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788568722.890585:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568722.890605:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabc00/0x41e82f464b6a15c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bec76 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568722.890667:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a15c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568722.890679:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a15c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568722.890692:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a15c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788568722.890725:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788568722.890757:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a15c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568722.890782:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabc00/0x41e82f464b6a15c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec76 expref: 62 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568722.890801:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a15c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec76 expref: 61 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568722.890810:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ae255fb9e00) 00010000:00010000:0.0:1788568722.890813:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788568722.890817:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae27feaa800, rc 0) 00000100:00100000:0.0:1788568722.890876:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fec7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+61:10550:x1875449958423552:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 311us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568722.890883:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 122 00000100:00100000:0.0:1788568722.897109:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568722.897199:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958423680 00000100:00100000:3.0:1788568722.897208:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958423680 00000100:00100000:3.0:1788568722.897274:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 38 00000100:00100000:3.0:1788568722.897284:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+9:2363:x1875449958423680:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788568722.897300:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568722.897318:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbb2afb4/0x41e82f464b6a15cf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bec7d expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788568722.897343:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b6491, blocks: 0x1 00010000:00010000:3.0:1788568722.897361:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=357s v=(0 0) 00010000:00010000:3.0:1788568722.897365:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788568722.897373:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbb2afb4/0x41e82f464b6a15cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec7d expref: 10 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.897389:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cbb2afb4/0x41e82f464b6a15cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec7d expref: 10 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.897401:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429dfe00, rc 0) 00000100:00100000:3.0:1788568722.897449:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+10:2363:x1875449958423680:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 166us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568722.897455:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 38 00000100:00100000:1.0:1788568722.914550:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568722.914640:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958423936 00000100:00100000:0.0:1788568722.914650:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958423936 00000100:00100000:0.0:1788568722.914705:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 123 00000100:00100000:0.0:1788568722.914714:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fec5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+61:10550:x1875449958423936:12345-192.168.206.4@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788568722.914815:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fec5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+61:10550:x1875449958423936:12345-192.168.206.4@tcp:57:lhsmtool_posix.0 Request processed in 102us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568722.914822:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 123 00000100:00100000:1.0:1788568722.926130:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568722.926447:0:8111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958424064 00000100:00100000:2.0:1788568722.926456:0:8111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958424064 00000100:00100000:2.0:1788568722.926509:0:8111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 39 00000100:00100000:2.0:1788568722.926519:0:8111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281709500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+10:10550:x1875449958424064:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788568722.926536:0:8111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568722.926553:0:8111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067957919/0x41e82f464b6a15d6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bec84 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.926600:0:8111:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cbb2afb4/0x41e82f464b6a15cf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec7d expref: 11 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.926609:0:8111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788568722.926613:0:8111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788568722.926619:0:8111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067957919/0x41e82f464b6a15d6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec84 expref: 11 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.926649:0:8111:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cbb2afb4/0x41e82f464b6a15cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec7d expref: 11 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568722.926662:0:8111:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cbb2afb4/0x41e82f464b6a15cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec7d expref: 11 pid: 6688 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568722.926675:0:8111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae281b01500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8111:1875449976262016:192.168.206.4@tcp:104: 00000100:00100000:2.0:1788568722.926793:0:8111:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae25265b300 going to sleep for 11 seconds 00000100:00100000:2.0:1788568722.935537:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244b34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976262528:0@lo:400:kworker.0 00000100:00100000:2.0:1788568722.935599:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568722.935638:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788568722.935644:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae281b00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976262144:0@lo:400:kworker.0 00000100:00100000:2.0:1788568722.935679:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568722.935702:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244b36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875449976262656:0@lo:400:kworker.0 00000100:00100000:2.0:1788568722.935728:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568722.935752:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae281b00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875449976262272:0@lo:400:kworker.0 00000100:00100000:2.0:1788568722.935789:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568722.935808:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244b35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976262784:0@lo:400:kworker.0 00000100:00100000:2.0:1788568722.935827:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568722.935842:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788568722.935847:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244b34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976262400:0@lo:400:kworker.0 00000100:00100000:2.0:1788568722.935865:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568722.935892:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976262144 00000100:00100000:2.0:1788568722.935899:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976262144 00000100:00100000:0.0:1788568722.936175:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1788568722.936186:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae250448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+19:3306:x1875449976262144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568722.936398:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae250448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+19:3306:x1875449976262144:12345-0@lo:400:kworker.0 Request processed in 214us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568722.936414:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788568722.942748:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976262528 00000100:00100000:1.0:1788568722.942764:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976262528 00000100:00100000:1.0:1788568722.942830:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976262784 00000100:00100000:1.0:1788568722.942834:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976262784 00000100:00100000:1.0:1788568722.942855:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788568722.942864:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875449976262528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568722.942979:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875449976262528:12345-0@lo:400:kworker.0 Request processed in 116us (7379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568722.942986:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788568722.943002:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788568722.943008:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cce6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3308:x1875449976262784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568722.943043:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cce6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3308:x1875449976262784:12345-0@lo:400:kworker.0 Request processed in 35us (7215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568722.943049:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788568722.943069:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976262656 00000100:00100000:1.0:1788568722.943089:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976262656 00000100:00100000:1.0:1788568722.943117:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976262272 00000100:00100000:1.0:1788568722.943120:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976262272 00000100:00100000:1.0:1788568722.943131:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976262400 00000100:00100000:1.0:1788568722.943133:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976262400 00000100:00100000:1.0:1788568722.943148:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788568722.943153:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cce5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875449976262656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568722.943199:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cce5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875449976262656:12345-0@lo:400:kworker.0 Request processed in 46us (7471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568722.943205:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788568722.943228:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788568722.943235:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875449976262272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568722.943263:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875449976262272:12345-0@lo:400:kworker.0 Request processed in 29us (7473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568722.943269:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788568722.943281:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788568722.943287:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fa23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976262400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568722.943313:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fa23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976262400:12345-0@lo:400:kworker.0 Request processed in 27us (7447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568722.943319:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788568722.946234:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244b34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976262400:0@lo:400:kworker.0 00000100:00100000:2.0:1788568722.946256:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae281b00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875449976262272:0@lo:400:kworker.0 00000100:00100000:2.0:1788568722.946284:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244b35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976262784:0@lo:400:kworker.0 00000100:00100000:2.0:1788568722.946499:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae281b00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976262144:0@lo:400:kworker.0 00000100:00100000:2.0:1788568722.946514:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244b36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875449976262656:0@lo:400:kworker.0 00000100:00100000:2.0:1788568722.946527:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244b34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976262528:0@lo:400:kworker.0 00000100:00080000:0.0:1788568722.954128:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788568722.954139:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788568722.955797:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568722.955843:0:8111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae281b01500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8111:1875449976262016:192.168.206.4@tcp:104: 00010000:00010000:3.0:1788568722.955877:0:8111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067957919/0x41e82f464b6a15d6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec84 expref: 11 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.955898:0:8111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7be00, rc 0) 00000100:00100000:3.0:1788568722.955973:0:8111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281709500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+11:10550:x1875449958424064:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 29455us (29850us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568722.955983:0:8111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 39 00000100:00100000:3.0:1788568722.956018:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958424192 00000100:00100000:3.0:1788568722.956024:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958424192 00010000:00010000:3.0:1788568722.956050:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cbb2afb4/0x41e82f464b6a15cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec7d expref: 11 pid: 6688 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568722.956078:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 54 00000100:00100000:3.0:1788568722.956087:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25319f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+11:2363:x1875449958424192:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788568722.956101:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568722.956121:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cbb2afb4/0x41e82f464b6a15cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec7d expref: 11 pid: 6688 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.956134:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cbb2afb4/0x41e82f464b6a15cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec7d expref: 11 pid: 6688 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.956155:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbb2afb4/0x41e82f464b6a15cf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec7d expref: 11 pid: 6688 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.956196:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788568722.956201:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788568722.956209:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067957919/0x41e82f464b6a15d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec84 expref: 10 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.958620:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067957919/0x41e82f464b6a15d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec84 expref: 10 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568722.958679:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000067957919/0x41e82f464b6a15d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec84 expref: 10 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568722.958694:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739eea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5828:1875449976262912:192.168.206.4@tcp:105: 00000100:00100000:3.0:1788568722.958770:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27bcfb180 going to sleep for 11 seconds 00000100:00100000:0.0:1788568722.970624:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568722.970652:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958424320 00000100:00100000:0.0:1788568722.970660:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958424320 00002000:00100000:0.0:1788568722.970707:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9ae2526d5c00 x1875449958424320/t0(0) o4->27f83c0c-e36b-48ce-9485-80051fd252dc@192.168.206.4@tcp:158/0 lens 504/0 e 0 to 0 dl 1788568733 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788568722.970719:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae2526d5c00 with x1875449958424320 ext(0->12) 00002000:00010000:0.0:1788568722.970724:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ae2526d5c00 00000100:00100000:0.0:1788568722.970750:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 2 00000100:00100000:0.0:1788568722.970760:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+11:2364:x1875449958424320:12345-192.168.206.4@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788568722.971203:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+13:2364:x1875449958424320:12345-192.168.206.4@tcp:4:lhsmtool_posix.0 Request processed in 444us (586us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788568722.971211:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 2 00000100:00100000:3.0:1788568722.971426:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739eea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5828:1875449976262912:192.168.206.4@tcp:105: 00010000:00010000:3.0:1788568722.971445:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788568722.971467:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25319f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+13:2363:x1875449958424192:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 15381us (15681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568722.971475:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 54 00002000:00100000:0.0:1788568722.975580:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9ae2526d5c00 x1875449958424320/t4294967308(0) o4->27f83c0c-e36b-48ce-9485-80051fd252dc@192.168.206.4@tcp:158/0 lens 504/448 e 0 to 0 dl 1788568733 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788568722.975594:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae2526d5c00 with x1875449958424320 ext(0->12) 00002000:00010000:0.0:1788568722.975602:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ae2526d5c00 00000100:00100000:1.0:1788568722.977705:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568722.979360:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958424448 00000100:00100000:0.0:1788568722.979372:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958424448 00000100:00100000:0.0:1788568722.979431:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 124 00000100:00100000:0.0:1788568722.979440:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bed0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+61:10550:x1875449958424448:12345-192.168.206.4@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788568723.031363:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:3.0:1788568723.031382:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:0.0:1788568723.040008:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:0.0:1788568723.040034:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:0.0:1788568723.040056:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:0.0:1788568723.040077:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000001:00080000:0.0:1788568723.040109:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:0.0:1788568723.040123:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ae277d98300 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1788568723.040128:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ae273b22200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ae277d98f00 00000020:00080000:0.0:1788568723.040131:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ae273b22700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ae26f79f400 00000020:00080000:0.0:1788568723.040164:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ae27906ca80 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1788568723.040167:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ae273b22c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ae27906c900 00000020:00080000:0.0:1788568723.040170:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ae273b22100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ae277976c00 00000020:00080000:0.0:1788568723.040349:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1788568723.040515:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788568723.040535:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2526d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976263040:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788568723.040599:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568723.040666:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2526d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976263168:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788568723.040690:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568723.040720:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788568723.040726:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2526d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976263296:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788568723.040748:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568723.040782:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976263040 00000100:00100000:0.0:1788568723.040788:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976263040 00000100:00100000:0.0:1788568723.040823:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976263168 00000100:00100000:0.0:1788568723.040826:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976263168 00000100:00100000:0.0:1788568723.040838:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976263296 00000100:00100000:0.0:1788568723.040841:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976263296 00000100:00100000:0.0:1788568723.040858:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788568723.040866:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3309:x1875449976263040:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788568723.040900:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:0.0:1788568723.040923:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075aa03ab/0x41e82f464b6a15dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.040962:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df231d3b/0x41e82f464b6a139f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebe3 expref: 11 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.040971:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788568723.040975:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788568723.040979:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075aa03ab/0x41e82f464b6a15dd lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.041007:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000df231d3b/0x41e82f464b6a139f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebe3 expref: 11 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.041021:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000df231d3b/0x41e82f464b6a139f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebe3 expref: 11 pid: 6690 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568723.041033:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2526d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6691:1875449976263424:192.168.206.4@tcp:104: 00000100:00100000:0.0:1788568723.041085:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae26f6a3300 going to sleep for 11 seconds 00000100:00100000:0.0:1788568723.041101:0:8111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788568723.041109:0:8111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1875449976263168:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788568723.041232:0:8111:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788568723.041236:0:8111:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788568721 00002000:00010000:0.0:1788568723.041238:0:8111:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788568723.041240:0:8111:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788568721 -> 1788568721 00002000:00010000:0.0:1788568723.041248:0:8111:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788568723.041286:0:8111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3306:x1875449976263168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 178us (595us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788568723.041293:0:8111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788568723.041310:0:8111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788568723.041317:0:8111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976263296:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788568723.041328:0:8111:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:0.0:1788568723.041349:0:8111:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9b6490, atime: 0x6a9b6490, ctime: 0x6a9b6490, blocks: 0xb 00010000:00010000:0.0:1788568723.041354:0:8111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8e47797/0x41e82f464b6a15e4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.041362:0:8111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=357s v=(0 0) 00010000:00010000:0.0:1788568723.041365:0:8111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788568723.041370:0:8111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8e47797/0x41e82f464b6a15e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.041385:0:8111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8e47797/0x41e82f464b6a15e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.041394:0:8111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8e47797/0x41e82f464b6a15e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.041400:0:8111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8e47797/0x41e82f464b6a15e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.041415:0:8111:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788568723.041849:0:8111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1875449976263296:12345-0@lo:6:osp-syn-1-0.0 Request processed in 532us (1098us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788568723.041861:0:8111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:0.0:1788568723.041996:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788568723.042003:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8e47797/0x41e82f464b6a15e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.042012:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feabe00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788568723.042016:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8e47797/0x41e82f464b6a15e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.042025:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8e47797/0x41e82f464b6a15e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.042042:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8e47797/0x41e82f464b6a15e4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.042050:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8e47797/0x41e82f464b6a15e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.042066:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568723.042068:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568723.042070:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568723.042087:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bed0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+15:10550:x1875449958424448:12345-192.168.206.4@tcp:44:lhsmtool_posix.0 Request processed in 62646us (64390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568723.042095:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 124 00000100:00100000:0.0:1788568723.042097:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1788568723.042101:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:0.0:1788568723.042118:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ae27b683b80, transno 4294967301 00000004:00080000:0.0:1788568723.042128:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:0.0:1788568723.042143:0:3306:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9ae2526d7800 x1875449976263296/t4294967304(4294967304) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788568739 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788568723.042164:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ae2526d7800/2, rc 0, transno 4294967304 00000100:00100000:0.0:1788568723.042169:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2526d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976263296:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788568723.042185:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ae2526d6a00/2, rc 0, transno 4294967309 00000100:00100000:0.0:1788568723.042189:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2526d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976263168:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788568723.046644:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568723.046774:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2526d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6691:1875449976263424:192.168.206.4@tcp:104: 00010000:00010000:0.0:1788568723.046804:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000075aa03ab/0x41e82f464b6a15dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568723.047094:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958424576 00000100:00100000:3.0:1788568723.047102:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958424576 00000100:00100000:3.0:1788568723.047187:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 43 00000100:00100000:3.0:1788568723.047198:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bed2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+12:2363:x1875449958424576:12345-192.168.206.4@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788568723.050616:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568723.050836:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958424704 00000100:00100000:0.0:1788568723.050846:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958424704 00010000:00010000:0.0:1788568723.050887:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000df231d3b/0x41e82f464b6a139f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebe3 expref: 13 pid: 6690 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568723.050966:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 55 00000100:00100000:0.0:1788568723.050979:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bed3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+13:2363:x1875449958424704:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788568723.050993:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568723.050998:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000df231d3b/0x41e82f464b6a139f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebe3 expref: 13 pid: 6690 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.051011:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000df231d3b/0x41e82f464b6a139f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebe3 expref: 13 pid: 6690 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.051034:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df231d3b/0x41e82f464b6a139f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebe3 expref: 13 pid: 6690 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.051112:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788568723.051116:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788568723.051122:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000075aa03ab/0x41e82f464b6a15dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.051132:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075aa03ab/0x41e82f464b6a15dd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.051160:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788568723.051345:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bed3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+12:2363:x1875449958424704:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 366us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568723.051403:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 55 00010000:00010000:0.0:1788568723.051762:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000075aa03ab/0x41e82f464b6a15dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.051774:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075aa03ab/0x41e82f464b6a15dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.051784:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075aa03ab/0x41e82f464b6a15dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.051791:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075aa03ab/0x41e82f464b6a15dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.051852:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788568723.052515:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3309:x1875449976263040:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11647us (11913us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788568723.052524:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1788568723.052638:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788568723.052647:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075aa03ab/0x41e82f464b6a15dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568723.052670:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feabc00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:1.0:1788568723.052674:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075aa03ab/0x41e82f464b6a15dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568723.052684:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075aa03ab/0x41e82f464b6a15dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568723.052704:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075aa03ab/0x41e82f464b6a15dd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568723.052712:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075aa03ab/0x41e82f464b6a15dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568723.052734:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568723.052736:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568723.052738:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788568723.053809:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ae2526d4e00/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788568723.053820:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2526d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976263040:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788568723.080358:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bed2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+11:2363:x1875449958424576:12345-192.168.206.4@tcp:16:lhsmtool_posix.0 Request processed in 33147us (33708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568723.080373:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 43 00000001:00080000:0.0:1788568723.080374:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:0.0:1788568723.080385:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:1.0:1788568723.084531:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568723.084625:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958424960 00000100:00100000:2.0:1788568723.084635:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958424960 00000100:00100000:2.0:1788568723.084711:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 125 00000100:00100000:2.0:1788568723.084722:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bed1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+15:10550:x1875449958424960:12345-192.168.206.4@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788568723.084770:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568723.084795:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a15c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec76 expref: 15 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.084827:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ae255fb9e00) 00010000:00010000:2.0:1788568723.084832:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788568723.084860:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a15eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.084872:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a15eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.084882:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a15eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788568723.085202:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e00d07a0 reply state 00000000626318af transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a15eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568723.085211:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00080000:0.0:1788568723.085650:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788568723.085874:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bed1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+16:10550:x1875449958424960:12345-192.168.206.4@tcp:36:lhsmtool_posix.0 Request processed in 1151us (1348us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788568723.085883:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 125 00000100:00100000:1.0:1788568723.090715:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568723.090920:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958425088 00000100:00100000:2.0:1788568723.090959:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958425088 00000100:00100000:2.0:1788568723.091012:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 44 00000100:00100000:2.0:1788568723.091023:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2364:x1875449958425088:12345-192.168.206.4@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788568723.091303:0:6688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788568723.091307:0:6688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788568721 -> 1788568721 00002000:00010000:2.0:1788568723.091310:0:6688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788568720 00002000:00010000:2.0:1788568723.091312:0:6688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788568721 -> 1788568721 00002000:00010000:2.0:1788568723.091314:0:6688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788568723.091385:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+7:2364:x1875449958425088:12345-192.168.206.4@tcp:2:lhsmtool_posix.0 Request processed in 363us (678us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788568723.091393:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 44 00000100:00100000:3.0:1788568723.094291:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568723.094573:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958425344 00000100:00100000:1.0:1788568723.094585:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958425344 00000100:00100000:1.0:1788568723.094634:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 126 00000100:00100000:1.0:1788568723.094645:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+16:10550:x1875449958425344:12345-192.168.206.4@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788568723.094710:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a15f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568723.094728:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a15ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec68 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568723.094751:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a15f2 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568723.094786:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a15ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec68 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568723.094799:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a15ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec68 expref: 16 pid: 5843 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568723.094812:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c31880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1875449976263552:192.168.206.4@tcp:104: 00000100:00100000:1.0:1788568723.094889:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae244836b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788568723.099226:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00010000:00010000:0.0:1788568723.099368:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a15eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.099380:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a15eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.099387:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a15eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.099392:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7a600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568723.099396:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a15eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.099403:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a15eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.099421:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ae255fb9e00) 00010000:00010000:0.0:1788568723.099423:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788568723.099428:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a15eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.099434:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a15eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568723.099605:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958425472 00000100:00100000:2.0:1788568723.099614:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958425472 00010000:00010000:2.0:1788568723.099648:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a15ac lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec68 expref: 16 pid: 5843 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568723.099688:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 56 00000100:00100000:2.0:1788568723.099698:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+16:2364:x1875449958425472:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788568723.099712:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568723.099719:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a15ac lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec68 expref: 16 pid: 5843 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.099730:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a15ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec68 expref: 16 pid: 5843 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.099746:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ae255fb9e00) 00010000:00010000:2.0:1788568723.099750:0:6705:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a15f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.099759:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a15f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.099765:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a15f2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.099783:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568723.099843:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+16:2364:x1875449958425472:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 146us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568723.099856:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 56 00010000:00010000:3.0:1788568723.100536:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a15ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec68 expref: 15 pid: 5843 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568723.100552:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c31880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1875449976263552:192.168.206.4@tcp:104: 00010000:00010000:3.0:1788568723.100573:0:6714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a15f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568723.100582:0:6714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a15f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568723.100587:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a15f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568723.100614:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a15f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568723.100620:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a15f2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568723.100626:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a15f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568723.100631:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2de00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568723.100634:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a15f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568723.100653:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a15f2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568723.100664:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ae255fb9e00) 00010000:00010000:3.0:1788568723.100666:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788568723.100670:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a15f2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568723.100676:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a15f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568723.100718:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+14:10550:x1875449958425344:12345-192.168.206.4@tcp:55:lhsmtool_posix.0 Request processed in 6075us (6505us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788568723.100726:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 126 00000100:00100000:1.0:1788568723.106392:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568723.106497:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958425600 00000100:00100000:0.0:1788568723.106506:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958425600 00000100:00100000:0.0:1788568723.106564:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 45 00000100:00100000:0.0:1788568723.106575:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+7:2364:x1875449958425600:12345-192.168.206.4@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788568723.106619:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000075aa03ab/0x41e82f464b6a15f9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.106637:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067957919/0x41e82f464b6a15d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec84 expref: 7 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.106645:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788568723.106649:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788568723.106653:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075aa03ab/0x41e82f464b6a15f9 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.106686:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000067957919/0x41e82f464b6a15d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec84 expref: 7 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.106699:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000067957919/0x41e82f464b6a15d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec84 expref: 7 pid: 8111 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568723.106712:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2526d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6691:1875449976263680:192.168.206.4@tcp:104: 00000100:00100000:0.0:1788568723.106789:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae26f6a3780 going to sleep for 11 seconds 00000100:00100000:1.0:1788568723.113661:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568723.113754:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958425728 00000100:00100000:2.0:1788568723.113762:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958425728 00010000:00010000:2.0:1788568723.113798:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000067957919/0x41e82f464b6a15d6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec84 expref: 8 pid: 8111 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568723.113842:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 57 00000100:00100000:2.0:1788568723.113852:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+8:2363:x1875449958425728:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788568723.113866:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568723.113890:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000067957919/0x41e82f464b6a15d6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec84 expref: 8 pid: 8111 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.113904:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000067957919/0x41e82f464b6a15d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec84 expref: 8 pid: 8111 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.113969:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788568723.113974:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788568723.113980:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000075aa03ab/0x41e82f464b6a15f9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.113991:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075aa03ab/0x41e82f464b6a15f9 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.114011:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568723.114060:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+8:2363:x1875449958425728:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 210us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568723.114086:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 57 00010000:00010000:0.0:1788568723.114823:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067957919/0x41e82f464b6a15d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec84 expref: 7 pid: 8111 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568723.114855:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2526d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6691:1875449976263680:192.168.206.4@tcp:104: 00010000:00010000:0.0:1788568723.114880:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000075aa03ab/0x41e82f464b6a15f9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.114890:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000075aa03ab/0x41e82f464b6a15f9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.114897:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075aa03ab/0x41e82f464b6a15f9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.114981:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000075aa03ab/0x41e82f464b6a15f9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.114991:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075aa03ab/0x41e82f464b6a15f9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.114999:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075aa03ab/0x41e82f464b6a15f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.115007:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feabc00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788568723.115012:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075aa03ab/0x41e82f464b6a15f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.115021:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075aa03ab/0x41e82f464b6a15f9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.115045:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075aa03ab/0x41e82f464b6a15f9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.115052:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075aa03ab/0x41e82f464b6a15f9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568723.115110:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2364:x1875449958425600:12345-192.168.206.4@tcp:1:lhsmtool_posix.0 Request processed in 8536us (8726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568723.115119:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 45 00000100:00100000:1.0:1788568723.118537:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568723.118636:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958425984 00000100:00100000:3.0:1788568723.118646:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958425984 00000100:00100000:3.0:1788568723.118706:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 127 00000100:00100000:3.0:1788568723.118716:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae14350f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+14:10550:x1875449958425984:12345-192.168.206.4@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788568723.118790:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a1600 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568723.118807:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a1600 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568723.118819:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a1600 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.120322:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1607 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.120342:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a15ba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec6f expref: 15 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.120351:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1607 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.120385:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a15ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec6f expref: 15 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.120400:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a15ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec6f expref: 15 pid: 6714 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568723.120412:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26fa22680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875449976263808:192.168.206.4@tcp:104: 00000100:00100000:2.0:1788568723.120505:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae253117a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788568723.124401:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568723.124516:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26fa22680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875449976263808:192.168.206.4@tcp:104: 00010000:00010000:2.0:1788568723.124544:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1607 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568723.124905:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958426112 00000100:00100000:3.0:1788568723.124914:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958426112 00010000:00010000:3.0:1788568723.125006:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a15ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec6f expref: 16 pid: 6714 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568723.125040:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 58 00000100:00100000:3.0:1788568723.125049:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae14350c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+16:2363:x1875449958426112:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788568723.125063:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568723.125069:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a15ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec6f expref: 16 pid: 6714 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568723.125080:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a15ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec6f expref: 16 pid: 6714 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568723.125102:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a15ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec6f expref: 16 pid: 6714 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568723.125118:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ae255fb9e00) 00010000:00010000:3.0:1788568723.125123:0:6705:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1607 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568723.125132:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1607 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568723.125140:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1607 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568723.125175:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788568723.125231:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae14350c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+15:2363:x1875449958426112:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 182us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568723.125239:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 58 00010000:00010000:2.0:1788568723.125868:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1607 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.125878:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1607 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788568723.126141:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1788568723.126338:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1788568723.126382:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1788568723.126705:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26fa22680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5844:1875449976263936:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788568723.126765:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568723.126800:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24609c300 going to sleep for 11 seconds 00000100:00100000:1.0:1788568723.126917:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976263936 00000100:00100000:1.0:1788568723.126955:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976263936 00000100:00100000:1.0:1788568723.126999:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788568723.127008:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fa23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5844:x1875449976263936:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788568723.127085:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fa23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5844:x1875449976263936:12345-0@lo:1000:mdt00_002.0 Request processed in 79us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568723.127092:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788568723.127790:0:5844:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1788568723.127797:0:5844:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:2.0:1788568723.127817:0:5844:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ae2526d6a00, transno 4294967309 00000100:00100000:2.0:1788568723.127838:0:5844:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9ae2526d4e00 x1875449976263040/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788568739 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568723.127850:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26fa22680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5844:1875449976263936:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788568723.128866:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1788568723.129061:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26fa22680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5844:1875449976264064:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788568723.129115:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568723.129152:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24609ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1788568723.129344:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976264064 00000100:00100000:3.0:1788568723.129351:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976264064 00000100:00100000:3.0:1788568723.129396:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788568723.129405:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fa22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5844:x1875449976264064:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788568723.130792:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fa22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5844:x1875449976264064:12345-0@lo:1000:mdt00_002.0 Request processed in 1381us (1669us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788568723.130805:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788568723.130900:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26fa22680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5844:1875449976264064:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788568723.131078:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1607 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.131089:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1607 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.131097:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1607 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.131103:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7a200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568723.131107:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1607 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.131133:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1607 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.131148:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ae255fb9e00) 00010000:00010000:2.0:1788568723.131151:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788568723.131156:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1607 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.131245:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1607 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.131278:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a154a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.131285:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a154a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.131291:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a154a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.131296:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2c200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568723.131300:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a154a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.131306:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a154a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.131314:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ae2430ad200) 00010000:00010000:2.0:1788568723.131316:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788568723.131323:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a1551 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec53 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.131344:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a1551 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec53 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.131354:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a1551 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec53 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.131388:0:5844:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a1551 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec53 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568723.131400:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26fa20000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875449976264192:192.168.206.4@tcp:105: 00000100:00100000:2.0:1788568723.131592:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24609ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1788568723.135791:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568723.135886:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958426240 00000100:00100000:3.0:1788568723.135895:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958426240 00000100:00100000:3.0:1788568723.135979:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 31 00000100:00100000:3.0:1788568723.135990:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae14350c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+19:10549:x1875449958426240:12345-192.168.206.4@tcp:49:lfs.0 00000100:00100000:3.0:1788568723.136113:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae14350c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+19:10549:x1875449958426240:12345-192.168.206.4@tcp:49:lfs.0 Request processed in 124us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568723.136120:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 31 00000100:00100000:2.0:1788568723.140139:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26fa20000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875449976264192:192.168.206.4@tcp:105: 00010000:00010000:2.0:1788568723.140178:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a154a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.140189:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a154a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.140235:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a160e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.140249:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a160e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.140260:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a160e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.140271:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a160e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.140292:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a160e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.140298:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a160e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.140303:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7a200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568723.140307:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a160e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.140315:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a160e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.140326:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ae2430ad200) 00010000:00010000:2.0:1788568723.140329:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788568723.140333:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a160e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.140338:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a160e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.140349:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a1600 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.140354:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a1600 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.140360:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a1600 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.140364:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429df400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568723.140373:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a1600 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.140379:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a1600 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.140387:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ae2430ad200) 00010000:00010000:2.0:1788568723.140390:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788568723.140392:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a1600 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.140399:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a1600 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568723.140775:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae14350f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+18:10550:x1875449958425984:12345-192.168.206.4@tcp:57:lhsmtool_posix.0 Request processed in 22058us (22246us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1788568723.140786:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 127 00000020:00080000:2.0:1788568723.140791:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788568723.141762:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788568723.141769:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788568723.142400:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788568723.142413:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788568723.146069:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568723.147437:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958426496 00000100:00100000:3.0:1788568723.147533:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958426496 00000100:00100000:3.0:1788568723.147610:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 128 00000100:00100000:3.0:1788568723.147620:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+18:10549:x1875449958426496:12345-192.168.206.4@tcp:58:lfs.0 00000040:00080000:3.0:1788568723.148314:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1788568723.148492:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+18:10549:x1875449958426496:12345-192.168.206.4@tcp:58:lfs.0 Request processed in 870us (2574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568723.148503:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 128 00000100:00100000:1.0:1788568723.150708:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568723.151608:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958426752 00000100:00100000:0.0:1788568723.151620:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958426752 00000100:00100000:0.0:1788568723.151685:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 32 00000100:00100000:0.0:1788568723.151695:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24926f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+18:10550:x1875449958426752:12345-192.168.206.4@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788568723.152685:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788568723.152802:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1788568723.152857:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabc00/0x41e82f464b6a1615 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.152873:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabc00/0x41e82f464b6a1615 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.152887:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabc00/0x41e82f464b6a1615 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.152898:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabc00/0x41e82f464b6a1615 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.152917:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabc00/0x41e82f464b6a1615 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.152923:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabc00/0x41e82f464b6a1615 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568723.153677:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788568723.153784:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24926f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+20:10550:x1875449958426752:12345-192.168.206.4@tcp:35:lhsmtool_posix.0 Request processed in 2087us (3079us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1788568723.153795:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 32 00000020:00080000:0.0:1788568723.153800:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788568723.155279:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788568723.155292:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabc00/0x41e82f464b6a1615 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568723.155302:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feabc00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:1.0:1788568723.155306:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabc00/0x41e82f464b6a1615 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568723.155315:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabc00/0x41e82f464b6a1615 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568723.155335:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ae24515a700) 00010000:00010000:1.0:1788568723.155338:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788568723.155344:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabc00/0x41e82f464b6a1615 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568723.155350:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabc00/0x41e82f464b6a1615 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568723.155372:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568723.155374:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568723.155376:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568723.194211:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568723.194408:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958426880 00000100:00100000:2.0:1788568723.194418:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958426880 00000100:00100000:2.0:1788568723.194495:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 129 00000100:00100000:2.0:1788568723.194505:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+20:10552:x1875449958426880:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:2.0:1788568723.194528:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568723.194550:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a161c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bec8b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.194608:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1623 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.194622:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1623 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.194646:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1623 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.194662:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a162a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.194669:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a162a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.194675:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a162a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.194905:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a1631 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.194917:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a153c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec4c expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.194982:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a1631 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.195016:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a153c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec4c expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.195031:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a153c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec4c expref: 21 pid: 5842 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568723.195045:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26fa20000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875449976264320:192.168.206.4@tcp:104: 00000100:00100000:2.0:1788568723.195123:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24609c000 going to sleep for 11 seconds 00000100:00100000:2.0:1788568723.198678:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568723.198773:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26fa20000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875449976264320:192.168.206.4@tcp:104: 00010000:00010000:3.0:1788568723.198799:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a1631 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568723.198884:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958427136 00000100:00100000:0.0:1788568723.198891:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958427136 00000100:00100000:0.0:1788568723.198974:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 33 00000100:00100000:0.0:1788568723.198983:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281b03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+22:5599:x1875449958427136:12345-192.168.206.4@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788568723.199463:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281b03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+23:5599:x1875449958427136:12345-192.168.206.4@tcp:35:ldlm_bl.0 Request processed in 479us (791us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1788568723.199472:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 33 00000100:00100000:1.0:1788568723.203251:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568723.203437:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958427264 00000100:00100000:2.0:1788568723.203456:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958427264 00010000:00010000:2.0:1788568723.203495:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a153c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec4c expref: 23 pid: 5842 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568723.203535:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 59 00000100:00100000:2.0:1788568723.203545:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+23:2363:x1875449958427264:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788568723.203559:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568723.203565:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a153c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec4c expref: 23 pid: 5842 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.203577:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a153c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec4c expref: 23 pid: 5842 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.203598:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a153c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec4c expref: 23 pid: 5842 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.203615:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ae2430ad200) 00010000:00010000:2.0:1788568723.203619:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a1631 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.203628:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a1631 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.203636:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a1631 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568723.203665:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568723.203741:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+22:2363:x1875449958427264:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 196us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568723.203748:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 59 00010000:00010000:3.0:1788568723.203877:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a1631 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568723.203886:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a1631 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788568723.203961:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788568723.203966:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788568723.203988:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a1631 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568723.204001:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a1631 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568723.204011:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1623 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568723.204017:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1623 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568723.204024:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1623 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568723.204030:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7a200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568723.204035:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1623 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568723.204042:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1623 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568723.204052:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ae25820c700) 00010000:00010000:3.0:1788568723.204062:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788568723.204066:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1623 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568723.204073:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1623 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568723.204086:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a162a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568723.204091:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a162a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568723.204097:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a162a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568723.204102:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7be00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568723.204105:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a162a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568723.204112:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a162a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568723.204120:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ae255fb9e00) 00010000:00010000:3.0:1788568723.204123:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788568723.204137:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a162a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568723.204144:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a162a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568723.204188:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a161c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec8b expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568723.204224:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a1631 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec8b expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568723.204233:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ae2430ad200) 00010000:00010000:3.0:1788568723.204235:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788568723.204237:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7bc00, rc 0) 00000100:00100000:3.0:1788568723.204266:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+21:10552:x1875449958426880:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 9764us (10065us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568723.204274:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 129 00000100:00100000:1.0:1788568723.450187:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788568723.450210:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26fa20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976264448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788568723.450288:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568723.451285:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976264448 00000100:00100000:3.0:1788568723.451295:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976264448 00000100:00100000:3.0:1788568723.451358:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788568723.451368:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875449976264448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788568723.451391:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1788568723.451456:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875449976264448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568723.451463:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788568723.451619:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26fa20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976264448:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788568723.657222:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788568723.931517:0:12061:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788568723.931526:0:12061:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788568723.931568:0:12061:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788568723.931576:0:12061:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788568723.964653:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788568723.964684:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae281b02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976264576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788568723.965066:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568723.965246:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976264576 00000100:00100000:2.0:1788568723.965254:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976264576 00000100:00100000:2.0:1788568723.965305:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788568723.965314:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fa20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875449976264576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788568723.965348:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1788568723.965401:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fa20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875449976264576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568723.965409:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788568723.965454:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae281b02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976264576:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788568724.151312:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788568724.151331:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788568724.151369:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788568724.151375:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788568724.151504:0:11686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244b2f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11686:1875449976264704:192.168.206.4@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788568724.151663:0:11686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2448363c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788568724.164097:0:11686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244b2f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11686:1875449976264704:192.168.206.4@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788568724.164425:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568724.167303:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958427392 00000100:00100000:1.0:1788568724.167317:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958427392 00000100:00100000:1.0:1788568724.167384:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 130 00000100:00100000:1.0:1788568724.167395:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+21:10564:x1875449958427392:12345-192.168.206.4@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788568724.167426:0:6714:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788568724.167539:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+21:10564:x1875449958427392:12345-192.168.206.4@tcp:53:lhsmtool_posix.0 Request processed in 145us (3114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568724.167547:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 130 00000100:00100000:1.0:1788568724.171167:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568724.171283:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958427648 00000100:00100000:0.0:1788568724.171292:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958427648 00000100:00100000:0.0:1788568724.171350:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 131 00000100:00100000:0.0:1788568724.171361:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+21:10564:x1875449958427648:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788568724.171380:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568724.171416:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a1638 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bec92 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568724.171514:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a163f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568724.171530:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a163f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568724.171542:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a163f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788568724.171553:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788568724.171678:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a1638 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec92 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568724.171698:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a163f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec92 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568724.171706:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ae2430ad200) 00010000:00010000:0.0:1788568724.171709:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788568724.171712:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae27feaa800, rc 0) 00000100:00100000:0.0:1788568724.171780:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+23:10564:x1875449958427648:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 421us (621us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1788568724.171788:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 131 00000100:00100000:2.0:1788568724.178089:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568724.178318:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958427904 00000100:00100000:1.0:1788568724.178330:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958427904 00000100:00100000:1.0:1788568724.178402:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 132 00000100:00100000:1.0:1788568724.178414:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281b02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+23:10564:x1875449958427904:12345-192.168.206.4@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788568724.178516:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a164d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568724.178536:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a164d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568724.178551:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a164d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568724.178783:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a164d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568724.178810:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a164d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568724.178817:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a164d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568724.178823:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2d400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568724.178829:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a164d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568724.178838:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a164d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568724.178852:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ae2430ad200) 00010000:00010000:1.0:1788568724.178856:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788568724.178861:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a164d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568724.178869:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a164d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568724.179123:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281b02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+24:10564:x1875449958427904:12345-192.168.206.4@tcp:57:lhsmtool_posix.0 Request processed in 706us (1045us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1788568724.179144:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 132 00000040:00080000:0.0:1788568724.179276:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788568724.179285:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788568724.179746:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788568724.179756:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788568724.179894:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568724.180004:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958428032 00000100:00100000:3.0:1788568724.180014:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958428032 00000100:00100000:3.0:1788568724.180079:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 8 00000100:00100000:3.0:1788568724.180091:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281b03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+24:2362:x1875449958428032:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788568724.180107:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568724.180140:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a163f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec92 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568724.180159:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ae2430ad200) 00010000:00010000:3.0:1788568724.180164:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788568724.180229:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281b03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+23:2362:x1875449958428032:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 141us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568724.180236:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 8 00000100:00100000:1.0:1788568724.189920:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568724.190073:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958428288 00000100:00100000:3.0:1788568724.190087:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958428288 00000100:00100000:3.0:1788568724.190176:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 34 00000100:00100000:3.0:1788568724.190189:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+23:10564:x1875449958428288:12345-192.168.206.4@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788568724.190668:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+24:10564:x1875449958428288:12345-192.168.206.4@tcp:35:lhsmtool_posix.0 Request processed in 479us (760us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788568724.190677:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 34 00010000:00010000:0.0:1788568724.663283:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568725.688963:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788568726.008116:0:12112:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788568726.008132:0:12112:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788568726.008278:0:12112:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788568726.008287:0:12112:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788568726.042554:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568726.042612:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568726.042658:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568726.042687:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568726.042720:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568726.042760:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958428800 00000100:00100000:2.0:1788568726.042775:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958428800 00000100:00100000:2.0:1788568726.042846:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958428672 00000100:00100000:2.0:1788568726.042850:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958428672 00000100:00100000:2.0:1788568726.042877:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 79 00000100:00100000:2.0:1788568726.042889:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281b01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2362:x1875449958428800:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:2.0:1788568726.044528:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281b01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2362:x1875449958428800:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 1626us (1900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568726.044564:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 79 00000100:00100000:2.0:1788568726.044610:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 80 00000100:00100000:2.0:1788568726.044624:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281b00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2362:x1875449958428672:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:2.0:1788568726.044668:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281b00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2362:x1875449958428672:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 49us (1980us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568726.044674:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 80 00000100:00100000:2.0:1788568726.044708:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958428416 00000100:00100000:2.0:1788568726.044717:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958428416 00000100:00100000:2.0:1788568726.044757:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 289 00000100:00100000:2.0:1788568726.044764:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae250448850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+13:2362:x1875449958428416:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:2.0:1788568726.044791:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae250448850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+13:2362:x1875449958428416:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 27us (2132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568726.044798:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 289 00000100:00100000:2.0:1788568726.044838:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958428544 00000100:00100000:2.0:1788568726.044842:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958428544 00000100:00100000:2.0:1788568726.044881:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958428928 00000100:00100000:2.0:1788568726.044884:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958428928 00000100:00100000:2.0:1788568726.044909:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 140 00000100:00100000:2.0:1788568726.044916:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281b01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+24:2362:x1875449958428544:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:3.0:1788568726.045344:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 141 00000100:00100000:3.0:1788568726.045358:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281b00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2362:x1875449958428928:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:3.0:1788568726.045402:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281b00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2362:x1875449958428928:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 49us (2681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568726.045409:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 141 00000100:00080000:3.0:1788568726.046340:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788568726.046350:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788568726.046353:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788568726.046771:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281b01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+24:2362:x1875449958428544:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 1845us (4225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568726.046785:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 140 00000100:00100000:2.0:1788568726.210340:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568726.210494:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958429184 00000100:00100000:3.0:1788568726.210507:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958429184 00000100:00100000:3.0:1788568726.210579:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 133 00000100:00100000:3.0:1788568726.210592:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+24:10585:x1875449958429184:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:3.0:1788568726.210618:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568726.210644:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a1654 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bec99 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568726.210773:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a165b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568726.210792:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a165b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568726.210806:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a165b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788568726.210818:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788568726.211824:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df400/0x41e82f464b6a1654 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec99 expref: 27 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568726.211852:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a165b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec99 expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568726.211879:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ae2430ad200) 00010000:00010000:1.0:1788568726.211882:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788568726.211887:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429dfe00, rc 0) 00000100:00100000:1.0:1788568726.212000:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+26:10585:x1875449958429184:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 1409us (1673us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1788568726.212009:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 133 00000100:00100000:2.0:1788568726.215504:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568726.215595:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958429312 00000100:00100000:3.0:1788568726.215609:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958429312 00000100:00100000:3.0:1788568726.215676:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 134 00000100:00100000:3.0:1788568726.215687:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+26:10585:x1875449958429312:12345-192.168.206.4@tcp:54:lfs.0 00010000:00010000:3.0:1788568726.215778:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1669 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568726.215798:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1669 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568726.215828:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1669 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568726.215861:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1669 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568726.215869:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1669 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568726.215878:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1669 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568726.215884:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429de600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568726.215890:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1669 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568726.215897:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1669 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568726.215910:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ae2430ad200) 00010000:00010000:3.0:1788568726.215913:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788568726.215919:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1669 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568726.216035:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1669 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568726.216160:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+26:10585:x1875449958429312:12345-192.168.206.4@tcp:54:lfs.0 Request processed in 474us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568726.216170:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 134 00000100:00100000:2.0:1788568726.326361:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568726.326476:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958429440 00000100:00100000:0.0:1788568726.326489:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958429440 00000100:00100000:0.0:1788568726.326567:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 46 00000100:00100000:0.0:1788568726.326580:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2364:x1875449958429440:12345-192.168.206.4@tcp:101:cat.0 00010000:00010000:0.0:1788568726.326604:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568726.326631:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075aa03ab/0x41e82f464b6a1670 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beca0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788568726.326665:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9b6491, atime: 0x6a9b6490, ctime: 0x6a9b6491, blocks: 0xb 00010000:00010000:0.0:1788568726.326690:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=360s v=(0 0) 00010000:00010000:0.0:1788568726.326695:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788568726.326706:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075aa03ab/0x41e82f464b6a1670 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beca0 expref: 7 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568726.326728:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000075aa03ab/0x41e82f464b6a1670 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beca0 expref: 7 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568726.326743:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae27feabc00, rc 0) 00000100:00100000:0.0:1788568726.326819:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+7:2364:x1875449958429440:12345-192.168.206.4@tcp:101:cat.0 Request processed in 241us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568726.326827:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 46 00000100:00100000:2.0:1788568726.330437:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568726.330517:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958429568 00000100:00100000:3.0:1788568726.330548:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958429568 00002000:00100000:3.0:1788568726.330611:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9ae244b34000 x1875449958429568/t0(0) o3->27f83c0c-e36b-48ce-9485-80051fd252dc@192.168.206.4@tcp:162/0 lens 488/0 e 0 to 0 dl 1788568737 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788568726.330632:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae244b34000 with x1875449958429568 ext(0->4095) 00002000:00010000:3.0:1788568726.330638:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ae244b34000 00000100:00100000:3.0:1788568726.330669:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 3 00000100:00100000:3.0:1788568726.330679:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+7:2363:x1875449958429568:12345-192.168.206.4@tcp:3:cat.0 00000100:00100000:3.0:1788568726.331087:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+7:2363:x1875449958429568:12345-192.168.206.4@tcp:3:cat.0 Request processed in 407us (669us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788568726.331095:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 3 00002000:00100000:3.0:1788568726.331103:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9ae244b34000 x1875449958429568/t0(0) o3->27f83c0c-e36b-48ce-9485-80051fd252dc@192.168.206.4@tcp:162/0 lens 488/4536 e 0 to 0 dl 1788568737 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788568726.331111:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae244b34000 with x1875449958429568 ext(0->4095) 00002000:00010000:3.0:1788568726.331115:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ae244b34000 00010000:00010000:1.0:1788568726.712879:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568727.736559:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568728.056295:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788568728.056354:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2526d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925db6b8-84bc-418c-b37a-40345c1020be:3307:1875449976264832:0@lo:400:kworker.0 00000100:00100000:0.0:1788568728.056475:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568728.056543:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae14350c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875449976264960:0@lo:400:kworker.0 00000100:00100000:0.0:1788568728.056576:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568728.057089:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277d95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976265088:0@lo:400:kworker.0 00000100:00100000:3.0:1788568728.057129:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568728.057230:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976264960 00000100:00100000:3.0:1788568728.057240:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976264960 00000100:00100000:0.0:1788568728.057251:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277d97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976265216:0@lo:400:kworker.0 00000100:00100000:1.0:1788568728.057269:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976265088 00000100:00100000:1.0:1788568728.057275:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976265088 00000100:00100000:3.0:1788568728.057297:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788568728.057310:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277971c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875449976264960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568728.057448:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568728.057542:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788568728.057553:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2530f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976265088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568728.057601:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2530f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976265088:12345-0@lo:400:kworker.0 Request processed in 50us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568728.057610:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788568728.057989:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976265216 00000100:00100000:0.0:1788568728.057996:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976265216 00000100:00100000:0.0:1788568728.058033:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788568728.058110:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277971180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3309:x1875449976265216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568728.058226:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277971180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3309:x1875449976265216:12345-0@lo:400:kworker.0 Request processed in 185us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568728.058235:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1788568728.059497:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788568728.059507:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788568728.059541:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277d95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875449976265344:0@lo:400:kworker.0 00000100:00100000:1.0:1788568728.059609:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568728.059655:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788568728.059662:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26f93ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976265472:0@lo:400:kworker.0 00000100:00100000:1.0:1788568728.059690:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568728.059768:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277d95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976265088:0@lo:400:kworker.0 00000100:00100000:1.0:1788568728.061095:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277d97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976265216:0@lo:400:kworker.0 00000100:00100000:3.0:1788568728.061705:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277971c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875449976264960:12345-0@lo:400:kworker.0 Request processed in 4108us (4836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568728.061721:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788568728.061756:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976265344 00000100:00100000:3.0:1788568728.061764:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976265344 00000100:00100000:3.0:1788568728.061833:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788568728.061841:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875449976265344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568728.061913:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875449976265344:12345-0@lo:400:kworker.0 Request processed in 73us (2304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568728.061919:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788568728.062097:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976264832 00000100:00100000:3.0:1788568728.062102:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976264832 00000100:00100000:0.0:1788568728.066183:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976265472 00000100:00100000:0.0:1788568728.066213:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976265472 00000100:00100000:0.0:1788568728.066282:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788568728.066294:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1875449976265472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568728.067880:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1875449976265472:12345-0@lo:400:kworker.0 Request processed in 1353us (7953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568728.067895:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788568728.069494:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788568728.069521:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae250449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+19:3307:x1875449976264832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568728.069651:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae250449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+19:3307:x1875449976264832:12345-0@lo:400:kworker.0 Request processed in 142us (13181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568728.069659:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788568728.070548:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26f93ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976265472:0@lo:400:kworker.0 00000100:00100000:1.0:1788568728.070566:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277d95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875449976265344:0@lo:400:kworker.0 00000100:00080000:1.0:1788568728.070620:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788568728.070627:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788568728.070656:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae14350c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875449976264960:0@lo:400:kworker.0 00000100:00100000:1.0:1788568728.070669:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2526d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925db6b8-84bc-418c-b37a-40345c1020be:3307:1875449976264832:0@lo:400:kworker.0 00000001:00080000:0.0:1788568728.154472:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000020:00080000:0.0:1788568728.154515:0:5865:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:0.0:1788568728.154530:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000020:00080000:0.0:1788568728.154543:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ae24609cf00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1788568728.154547:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ae250422b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ae24609c300 00000020:00080000:0.0:1788568728.154551:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ae250422500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ae2488e5c00 00000001:00080000:0.0:1788568728.154564:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1788568728.154588:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1788568728.154776:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:3.0:1788568728.156589:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1788568728.156810:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:3.0:1788568728.156950:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:3.0:1788568728.167061:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000100:00100000:2.0:1788568728.568371:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788568728.568402:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2530f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976265600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788568728.568503:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568728.568659:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976265600 00000100:00100000:3.0:1788568728.568670:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976265600 00000100:00100000:3.0:1788568728.568739:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788568728.568751:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b565180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976265600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788568728.568798:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788568728.568861:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b565180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976265600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568728.568868:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788568728.569021:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1788568728.569028:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ae2526d7800, transno 4294967304 00000100:00100000:0.0:1788568728.569056:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2530f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976265600:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788568728.759230:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568729.083594:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26f93ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976265728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788568729.083690:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568729.083912:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976265728 00000100:00100000:3.0:1788568729.083922:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976265728 00000100:00100000:3.0:1788568729.084006:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788568729.084018:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976265728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788568729.084077:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788568729.089708:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976265728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5673us (5997us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568729.089726:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788568729.090888:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1788568729.090899:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ae2526d4e00, transno 4294967310 00000004:00080000:2.0:1788568729.090920:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1788568729.090986:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26f93ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976265728:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788568729.786362:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568730.807600:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568731.174295:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568731.174349:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568731.174409:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568731.174445:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568731.174494:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568731.174543:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958430208 00000100:00100000:2.0:1788568731.174556:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958430208 00000100:00100000:2.0:1788568731.174632:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958429824 00000100:00100000:2.0:1788568731.174636:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958429824 00000100:00100000:2.0:1788568731.174663:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 145 00000100:00100000:2.0:1788568731.174675:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bcbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2364:x1875449958430208:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:2.0:1788568731.174775:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bcbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2364:x1875449958430208:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 101us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568731.174790:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 145 00000100:00100000:2.0:1788568731.174814:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 146 00000100:00100000:2.0:1788568731.174821:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bcbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+13:2364:x1875449958429824:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:2.0:1788568731.174853:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bcbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+13:2364:x1875449958429824:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 32us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568731.174859:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 146 00000100:00100000:2.0:1788568731.174884:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958429952 00000100:00100000:2.0:1788568731.174888:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958429952 00000100:00100000:2.0:1788568731.174916:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958430080 00000100:00100000:2.0:1788568731.174919:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958430080 00000100:00100000:2.0:1788568731.174980:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 83 00000100:00100000:2.0:1788568731.174987:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fa22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2364:x1875449958429952:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:2.0:1788568731.175015:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fa22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2364:x1875449958429952:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 29us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568731.175022:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 83 00000100:00100000:2.0:1788568731.175035:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 84 00000100:00100000:2.0:1788568731.175040:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bcbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2364:x1875449958430080:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:2.0:1788568731.175064:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bcbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2364:x1875449958430080:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 24us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568731.175071:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 84 00000100:00100000:3.0:1788568731.175526:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958429696 00000100:00100000:3.0:1788568731.175543:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958429696 00000100:00100000:3.0:1788568731.175582:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 291 00000100:00100000:3.0:1788568731.175589:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+13:2364:x1875449958429696:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:3.0:1788568731.175626:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+13:2364:x1875449958429696:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 38us (1348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568731.175632:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 291 00000100:00080000:1.0:1788568731.176490:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788568731.176499:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788568731.176503:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788568731.552314:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568731.552450:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958430336 00000100:00100000:1.0:1788568731.552466:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958430336 00000100:00100000:1.0:1788568731.552541:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 135 00000100:00100000:1.0:1788568731.552554:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bcbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+13:10237:x1875449958430336:12345-192.168.206.4@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788568731.552699:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bcbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+13:10237:x1875449958430336:12345-192.168.206.4@tcp:60:lhsmtool_posix.0 Request processed in 147us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568731.552707:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 135 00000100:00100000:2.0:1788568731.558496:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568731.558990:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958430592 00000100:00100000:0.0:1788568731.559004:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958430592 00000100:00100000:0.0:1788568731.559149:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 35 00000100:00100000:0.0:1788568731.559163:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bcbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+13:10237:x1875449958430592:12345-192.168.206.4@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788568731.560886:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bcbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+14:10237:x1875449958430592:12345-192.168.206.4@tcp:35:lhsmtool_posix.0 Request processed in 1704us (2381us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1788568731.560901:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 35 00010000:00010000:0.0:1788568731.834355:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568732.029019:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568732.029273:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958430720 00000100:00100000:2.0:1788568732.029286:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958430720 00000100:00100000:2.0:1788568732.029363:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 136 00000100:00100000:2.0:1788568732.029404:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2530f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:11039:x1875449958430720:12345-192.168.206.4@tcp:101:lsof.0 00010000:00010000:2.0:1788568732.029432:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568732.029457:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1677 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beca7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568732.029538:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a167e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568732.029556:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a167e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568732.029570:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a167e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788568732.029613:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788568732.029617:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788568732.029666:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a167e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568732.029696:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1677 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beca7 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568732.029718:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a167e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beca7 expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568732.029727:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae25820ca00) 00010000:00010000:2.0:1788568732.029730:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788568732.029734:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7b600, rc 0) 00000100:00100000:2.0:1788568732.029823:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2530f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be1fd6d4-5648-47eb-88cd-3d695851ff89+6:11039:x1875449958430720:12345-192.168.206.4@tcp:101:lsof.0 Request processed in 432us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568732.029841:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 136 00000040:00080000:1.0:1788568732.409671:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788568732.409684:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788568732.410112:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1788568732.410120:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788568732.856812:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568733.176098:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bcbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976266112:0@lo:400:kworker.0 00000100:00100000:2.0:1788568733.176201:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568733.176277:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788568733.176284:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bcbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976266240:0@lo:400:kworker.0 00000100:00100000:2.0:1788568733.176313:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568733.176322:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bcbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875449976265984:0@lo:400:kworker.0 00000100:00100000:2.0:1788568733.176354:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976266240 00000100:00100000:0.0:1788568733.176354:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568733.176363:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976266240 00000100:00100000:0.0:1788568733.176375:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bcbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976266496:0@lo:400:kworker.0 00000100:00100000:0.0:1788568733.176424:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568733.176437:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976266496 00000100:00100000:2.0:1788568733.176440:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976266496 00000100:00100000:0.0:1788568733.176454:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788568733.176460:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bcbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925db6b8-84bc-418c-b37a-40345c1020be:3307:1875449976265856:0@lo:400:kworker.0 00000100:00100000:2.0:1788568733.176466:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788568733.176489:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bcbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976266240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568733.176490:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568733.176511:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bcbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875449976266368:0@lo:400:kworker.0 00000100:00100000:0.0:1788568733.176531:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568733.176545:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bcbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976266240:12345-0@lo:400:kworker.0 Request processed in 58us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568733.176553:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788568733.176561:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976266112 00000100:00100000:0.0:1788568733.176564:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976266112 00000100:00100000:2.0:1788568733.176571:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788568733.176577:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976266496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568733.176593:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976265984 00000100:00100000:0.0:1788568733.176596:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976265984 00000100:00100000:2.0:1788568733.176608:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976266496:12345-0@lo:400:kworker.0 Request processed in 31us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568733.176609:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976266368 00000100:00100000:0.0:1788568733.176611:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976266368 00000100:00100000:2.0:1788568733.176615:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788568733.176625:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00080000:2.0:1788568733.176630:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788568733.176631:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bcbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976266112:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788568733.176635:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788568733.176637:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788568733.176688:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bcbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976266240:0@lo:400:kworker.0 00000100:00100000:2.0:1788568733.176731:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976265856 00000100:00100000:2.0:1788568733.176735:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976265856 00000100:00100000:2.0:1788568733.176767:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1788568733.176773:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+19:3307:x1875449976265856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568733.176856:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788568733.177149:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277971500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875449976265984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568733.179048:0:5844:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788568733.179066:0:5844:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1788568733.179223:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788568733.179247:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875449976266368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568733.182530:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bcbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976266112:12345-0@lo:400:kworker.0 Request processed in 5881us (6312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568733.189803:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+19:3307:x1875449976265856:12345-0@lo:400:kworker.0 Request processed in 5922us (6203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568733.189834:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1788568733.196883:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875449976266368:12345-0@lo:400:kworker.0 Request processed in 6353us (9059us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568733.197824:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277971500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875449976265984:12345-0@lo:400:kworker.0 Request processed in 5670us (6461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568733.199515:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788568733.199692:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bcbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925db6b8-84bc-418c-b37a-40345c1020be:3307:1875449976265856:0@lo:400:kworker.0 00000100:00100000:0.0:1788568733.199719:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bcbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875449976266368:0@lo:400:kworker.0 00000100:00100000:0.0:1788568733.199733:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bcbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875449976265984:0@lo:400:kworker.0 00000100:00100000:0.0:1788568733.199747:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bcbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976266496:0@lo:400:kworker.0 00000100:00100000:3.0:1788568733.203328:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788568733.206850:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bcbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976266112:0@lo:400:kworker.0 00000100:00100000:1.0:1788568733.208998:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000001:00080000:2.0:1788568733.285069:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1788568733.285093:0:5865:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1788568733.285187:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1788568733.285203:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1788568733.690579:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788568733.690613:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cd84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976266624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788568733.690713:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568733.690862:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976266624 00000100:00100000:1.0:1788568733.690874:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976266624 00000100:00100000:1.0:1788568733.691001:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788568733.691014:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bcbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976266624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788568733.691067:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788568733.691131:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bcbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976266624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568733.691167:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788568733.691215:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cd84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976266624:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788568733.879227:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568734.201194:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26f93d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976266752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788568734.201304:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568734.201466:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976266752 00000100:00100000:3.0:1788568734.201478:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976266752 00000100:00100000:3.0:1788568734.201554:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788568734.201566:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bcbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976266752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788568734.201616:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788568734.208657:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bcbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976266752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7077us (7338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568734.208677:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788568734.214751:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26f93d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976266752:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788568734.910388:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568735.927196:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568736.272838:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568736.272898:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568736.272980:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568736.273019:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568736.273049:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568736.273081:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958430848 00000100:00100000:0.0:1788568736.273247:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958430976 00000100:00100000:0.0:1788568736.273253:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958430976 00000100:00100000:0.0:1788568736.273322:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958431360 00000100:00100000:0.0:1788568736.273326:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958431360 00000100:00100000:0.0:1788568736.273353:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 150 00000100:00100000:0.0:1788568736.273373:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cd85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+13:2361:x1875449958430976:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:0.0:1788568736.273473:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cd85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+13:2361:x1875449958430976:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 102us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568736.273481:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 150 00000100:00100000:0.0:1788568736.273503:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 151 00000100:00100000:0.0:1788568736.273510:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cd87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be1fd6d4-5648-47eb-88cd-3d695851ff89+6:2361:x1875449958431360:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:0.0:1788568736.273535:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cd87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be1fd6d4-5648-47eb-88cd-3d695851ff89+6:2361:x1875449958431360:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 26us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568736.273541:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 151 00000100:00080000:0.0:1788568736.273559:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788568736.273699:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958431232 00000100:00100000:1.0:1788568736.273705:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958431232 00000100:00100000:3.0:1788568736.273762:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958430848 00000100:00100000:1.0:1788568736.273764:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958431104 00000100:00100000:1.0:1788568736.273770:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958431104 00000100:00100000:3.0:1788568736.273805:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 293 00000100:00100000:1.0:1788568736.273810:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 87 00000100:00100000:3.0:1788568736.273817:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae250449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+13:2361:x1875449958430848:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:1.0:1788568736.273826:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cd87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2361:x1875449958431232:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:3.0:1788568736.273859:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae250449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+13:2361:x1875449958430848:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 46us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568736.273869:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cd87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2361:x1875449958431232:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 48us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568736.273876:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 293 00000100:00100000:1.0:1788568736.273881:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 87 00000100:00100000:1.0:1788568736.273900:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 88 00000100:00100000:1.0:1788568736.273908:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cd86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2361:x1875449958431104:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:1.0:1788568736.273976:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cd86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2361:x1875449958431104:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 67us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568736.273984:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 88 00000100:00080000:0.0:1788568736.274411:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788568736.274415:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:0.0:1788568736.437246:0:12315:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 20:38:53 (1788568733) 00010000:00010000:0.0:1788568736.951390:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568737.960452:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568737.960664:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958431616 00000100:00100000:1.0:1788568737.960674:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958431616 00000100:00100000:1.0:1788568737.960736:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 137 00000100:00100000:1.0:1788568737.960747:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cd84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+13:11304:x1875449958431616:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788568737.960765:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568737.960785:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a1685 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9becae expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568737.960862:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a168c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568737.960888:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a168c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568737.960900:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a168c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568737.960915:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a1693 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568737.960921:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a1693 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568737.960960:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a1693 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568737.961264:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a169a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568737.961274:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a169a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568737.961282:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a169a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568737.961291:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788568737.961427:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a168c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568737.961435:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a168c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568737.961441:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a168c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568737.961453:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2ca00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568737.961458:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a168c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568737.961466:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a168c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568737.961477:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ae24515a400) 00010000:00010000:1.0:1788568737.961480:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568737.961484:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a168c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568737.961490:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a168c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568737.961502:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a1693 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568737.961508:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a1693 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568737.961513:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a1693 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568737.961518:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2c000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568737.961520:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a1693 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568737.961526:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a1693 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568737.961544:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ae25820c300) 00010000:00010000:1.0:1788568737.962188:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568737.962196:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a1693 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568737.962204:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a1693 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568737.962689:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a1685 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becae expref: 16 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568737.962705:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a169a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becae expref: 15 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568737.962713:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ae25820cd00) 00010000:00010000:1.0:1788568737.962716:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568737.962718:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2d800, rc 0) 00000100:00100000:1.0:1788568737.962792:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cd84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+15:11304:x1875449958431616:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 2046us (2349us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1788568737.962801:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 137 00000100:00100000:3.0:1788568737.970538:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568737.970587:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568737.970737:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958431744 00000100:00100000:0.0:1788568737.970745:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958431744 00000100:00100000:0.0:1788568737.970813:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 138 00000100:00100000:0.0:1788568737.970823:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+15:11304:x1875449958431744:12345-192.168.206.4@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788568737.970954:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+15:11304:x1875449958431744:12345-192.168.206.4@tcp:59:lhsmtool_posix.0 Request processed in 132us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568737.970961:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 138 00000100:00100000:1.0:1788568737.975230:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958431872 00000100:00100000:1.0:1788568737.975246:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958431872 00000100:00100000:1.0:1788568737.975320:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 9 00000100:00100000:1.0:1788568737.975331:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25319c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+15:2363:x1875449958431872:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788568737.975346:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788568737.975369:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a169a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becae expref: 15 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568737.975399:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568737.975406:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ae25820cd00) 00010000:00010000:1.0:1788568737.975411:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788568737.975480:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25319c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+14:2363:x1875449958431872:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 148us (4889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568737.975488:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 9 00000100:00100000:0.0:1788568738.295267:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875449976267008:0@lo:400:kworker.0 00000100:00100000:0.0:1788568738.295329:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568738.295376:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976267520:0@lo:400:kworker.0 00000100:00100000:0.0:1788568738.295412:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568738.295437:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788568738.295443:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925db6b8-84bc-418c-b37a-40345c1020be:3307:1875449976266880:0@lo:400:kworker.0 00000100:00100000:0.0:1788568738.295466:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568738.295481:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875449976267392:0@lo:400:kworker.0 00000100:00100000:0.0:1788568738.295499:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568738.295524:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976267136:0@lo:400:kworker.0 00000100:00100000:0.0:1788568738.295547:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568738.295563:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788568738.295568:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976267264:0@lo:400:kworker.0 00000100:00100000:0.0:1788568738.295588:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568738.295617:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976267008 00000100:00100000:0.0:1788568738.295624:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976267008 00000100:00100000:0.0:1788568738.295677:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976267392 00000100:00100000:0.0:1788568738.295681:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976267392 00000100:00100000:0.0:1788568738.295704:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976267136 00000100:00100000:0.0:1788568738.295707:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976267136 00000100:00100000:0.0:1788568738.295723:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788568738.295731:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875449976267008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568738.295777:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875449976267008:12345-0@lo:400:kworker.0 Request processed in 47us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568738.295785:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788568738.295801:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788568738.295808:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875449976267392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568738.295834:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875449976267392:12345-0@lo:400:kworker.0 Request processed in 27us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568738.295840:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788568738.295857:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788568738.295863:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976267136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568738.295890:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976267136:12345-0@lo:400:kworker.0 Request processed in 28us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568738.295896:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:0.0:1788568738.295912:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788568738.295958:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976267136:0@lo:400:kworker.0 00000100:00100000:0.0:1788568738.295984:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875449976267392:0@lo:400:kworker.0 00000100:00100000:0.0:1788568738.295993:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875449976267008:0@lo:400:kworker.0 00000100:00100000:3.0:1788568738.296952:0:8111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976267520 00000100:00100000:3.0:1788568738.296960:0:8111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976267520 00000100:00100000:3.0:1788568738.296995:0:8111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976267264 00000100:00100000:3.0:1788568738.296998:0:8111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976267264 00000100:00100000:3.0:1788568738.297014:0:8111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788568738.297021:0:8111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976267520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568738.297077:0:8111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976267520:12345-0@lo:400:kworker.0 Request processed in 57us (1664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568738.297083:0:8111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788568738.297095:0:8111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788568738.297100:0:8111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976267264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568738.297130:0:8111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976267264:12345-0@lo:400:kworker.0 Request processed in 30us (1541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568738.297148:0:8111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788568738.297166:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976266880 00000100:00100000:3.0:1788568738.297179:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976266880 00000100:00080000:1.0:1788568738.297283:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788568738.297287:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788568738.297329:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1788568738.297337:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+19:3307:x1875449976266880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568738.297367:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+19:3307:x1875449976266880:12345-0@lo:400:kworker.0 Request processed in 32us (1900us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568738.297373:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1788568738.297426:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976267264:0@lo:400:kworker.0 00000100:00100000:3.0:1788568738.297450:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925db6b8-84bc-418c-b37a-40345c1020be:3307:1875449976266880:0@lo:400:kworker.0 00000100:00100000:3.0:1788568738.297459:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976267520:0@lo:400:kworker.0 00000001:00080000:3.0:1788568738.325149:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000040:00080000:1.0:1788568738.551808:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788568738.551817:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788568738.551852:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1788568738.551859:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788568738.807152:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788568738.807179:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976267648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788568738.807254:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568738.807300:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976267648 00000100:00100000:3.0:1788568738.807308:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976267648 00000100:00100000:3.0:1788568738.807371:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788568738.807381:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bcbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976267648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788568738.807416:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788568738.807471:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bcbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976267648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568738.807478:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788568738.807655:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976267648:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788568739.000110:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568739.329633:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976267776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788568739.329704:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568739.329771:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976267776 00000100:00100000:0.0:1788568739.329778:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976267776 00000100:00100000:0.0:1788568739.329818:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788568739.329826:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273443850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976267776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788568739.329916:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788568739.329979:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273443850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976267776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568739.329986:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788568739.330309:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976267776:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788568740.029231:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568740.065192:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568740.068723:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958432000 00000100:00100000:3.0:1788568740.068737:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958432000 00000100:00100000:3.0:1788568740.068902:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 139 00000100:00100000:3.0:1788568740.068914:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+13:11346:x1875449958432000:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:3.0:1788568740.068946:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568740.068966:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a16a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9becb5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.069041:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a16af lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.069054:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a16af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.069065:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a16af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.069081:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a16b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.069089:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a16b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.069095:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a16b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.069291:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a16af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788568740.069292:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788568740.069302:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a16af lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.069319:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a16af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.069325:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429dea00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568740.069332:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a16af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.069350:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a16af lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.069362:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae25820ca00) 00010000:00010000:3.0:1788568740.069366:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788568740.069371:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a16af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.069378:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a16af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.069390:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a16b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.069397:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a16b6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.069403:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a16b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.069407:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429dee00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568740.069410:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a16b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.069416:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a16b6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.069422:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ae2430ad100) 00010000:00010000:3.0:1788568740.069425:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788568740.069428:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a16b6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.069441:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a16b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.069472:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a16a8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becb5 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.069481:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae25820ca00) 00010000:00010000:3.0:1788568740.069483:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788568740.069486:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a16a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becb5 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.069494:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429de600, rc 0) 00000100:00100000:3.0:1788568740.069554:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+13:11346:x1875449958432000:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 643us (4370us total) trans 0 rc 301/301 00000100:00100000:3.0:1788568740.069561:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 139 00000100:00100000:3.0:1788568740.078690:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568740.079750:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958432256 00000100:00100000:1.0:1788568740.079762:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958432256 00000100:00100000:1.0:1788568740.079816:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 140 00000100:00100000:1.0:1788568740.079826:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+13:11346:x1875449958432256:12345-192.168.206.4@tcp:36:lfs.0 00010000:00010000:1.0:1788568740.079879:0:6714:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788568740.079916:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a1026 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beaee expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.079950:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae25820ca00) 00010000:00010000:1.0:1788568740.079955:0:6714:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788568740.080244:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a16bd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.080258:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a167e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beca7 expref: 5 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.080273:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a16bd lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.080305:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a167e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beca7 expref: 5 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.080319:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a167e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beca7 expref: 5 pid: 5844 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568740.080333:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26f93ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1875449976267904:192.168.206.4@tcp:104: 00000100:00100000:1.0:1788568740.080418:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae242acbe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788568740.090494:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568740.090534:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958432384 00000100:00100000:1.0:1788568740.090542:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958432384 00010000:00010000:1.0:1788568740.090588:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a167e lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beca7 expref: 6 pid: 5844 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568740.091759:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 60 00000100:00100000:1.0:1788568740.091774:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be1fd6d4-5648-47eb-88cd-3d695851ff89+6:2363:x1875449958432384:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788568740.091790:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788568740.091798:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a167e lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beca7 expref: 6 pid: 5844 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.091813:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a167e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beca7 expref: 6 pid: 5844 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.091849:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae25820ca00) 00010000:00010000:1.0:1788568740.091854:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a16bd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.091863:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a16bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.091870:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a16bd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.091890:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788568740.093262:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be1fd6d4-5648-47eb-88cd-3d695851ff89+6:2363:x1875449958432384:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 193us (1477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568740.093276:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 60 00000100:00080000:1.0:1788568740.093417:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788568740.093627:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a167e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beca7 expref: 5 pid: 5844 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568740.093644:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26f93ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1875449976267904:192.168.206.4@tcp:104: 00010000:00010000:1.0:1788568740.093665:0:6714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a16bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.093674:0:6714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a16bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.093681:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a16bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.093701:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a16c4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.093719:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a16c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.093728:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a16c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568740.098469:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788568740.098492:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a16bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.098502:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a16bd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.098510:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a16bd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.098517:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2d600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568740.098522:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a16bd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.098531:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a16bd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.098547:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae25820ca00) 00010000:00010000:1.0:1788568740.098550:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568740.098555:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a16bd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.098561:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a16bd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788568740.098611:0:6714:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000074621f0 reply state 00000000e7be999a transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a16c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568740.098620:0:6714:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788568740.098724:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+14:11346:x1875449958432256:12345-192.168.206.4@tcp:36:lfs.0 Request processed in 18894us (20039us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1788568740.098733:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 140 00010000:00010000:3.0:1788568740.119432:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a16c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.119449:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a16c4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.119457:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a16c4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.119462:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2c400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568740.119467:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a16c4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.119491:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a16c4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.120020:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ae25820c300) 00010000:00010000:3.0:1788568740.120025:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788568740.120030:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a16c4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.120037:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a16c4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568740.286381:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568740.286435:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958432512 00000100:00100000:3.0:1788568740.286446:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958432512 00000100:00100000:3.0:1788568740.286519:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 141 00000100:00100000:3.0:1788568740.286531:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+13:11354:x1875449958432512:12345-192.168.206.4@tcp:101:lctl.0 00010000:00010000:3.0:1788568740.286555:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568740.286578:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a16cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9becbc expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.286640:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a16d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.286653:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a16d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.286664:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a16d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788568740.286695:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788568740.286711:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788568740.286736:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a16d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.286761:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a16cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becbc expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.286780:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a16d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becbc expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.286788:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae2430ad100) 00010000:00010000:3.0:1788568740.286790:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788568740.286793:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429dee00, rc 0) 00000100:00100000:3.0:1788568740.286872:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+14:11354:x1875449958432512:12345-192.168.206.4@tcp:101:lctl.0 Request processed in 343us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568740.286878:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 141 00000100:00100000:1.0:1788568740.440045:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568740.440170:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958432640 00000100:00100000:3.0:1788568740.440180:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958432640 00000100:00100000:3.0:1788568740.440236:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 142 00000100:00100000:3.0:1788568740.440246:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+14:11360:x1875449958432640:12345-192.168.206.4@tcp:101:bash.0 00010000:00010000:3.0:1788568740.440265:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568740.440286:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a16d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9becc3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.440349:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a16e0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.440363:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a16e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.440392:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a16e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.440408:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a16e7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.440414:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a16e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.440420:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a16e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.440514:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a16ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.440522:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a16ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.440528:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a16ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788568740.440553:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788568740.440556:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788568740.440574:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a16ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.440585:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a16e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.440591:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a16e0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.440608:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a16e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.440614:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429dea00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568740.440618:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a16e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.440625:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a16e0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.440637:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae2430ad100) 00010000:00010000:3.0:1788568740.440640:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788568740.440644:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a16e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.440651:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a16e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.440665:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a16e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.440671:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a16e7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.440677:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a16e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.440682:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429de800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568740.440685:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a16e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.440700:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a16e7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.440708:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ae2430ad900) 00010000:00010000:3.0:1788568740.440710:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788568740.440713:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a16e7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.440719:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a16e7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.440751:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a16d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becc3 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.440763:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a16ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becc3 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.440770:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ae2430ad300) 00010000:00010000:3.0:1788568740.440772:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788568740.440775:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429df000, rc 0) 00000100:00100000:3.0:1788568740.440846:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+15:11360:x1875449958432640:12345-192.168.206.4@tcp:101:bash.0 Request processed in 601us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568740.440862:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 142 00000100:00100000:2.0:1788568740.456877:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568740.457004:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958432896 00000100:00100000:1.0:1788568740.457015:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958432896 00000100:00100000:1.0:1788568740.457083:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 143 00000100:00100000:1.0:1788568740.457096:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bcbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+15:11360:x1875449958432896:12345-192.168.206.4@tcp:101:bash.0 00010000:00010000:1.0:1788568740.457117:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568740.457147:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a16f5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9becca expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.457270:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a16fc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.457284:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a16fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.457294:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a16fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.457348:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1703 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.457374:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1703 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.457382:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1703 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788568740.457994:0:6714:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1788568740.458173:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a170a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.458184:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a170a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.458192:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a170a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.458226:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a16fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.458233:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a16fc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.458239:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a16fc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.458245:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2dc00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568740.458249:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a16fc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.458256:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a16fc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.458280:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ae2430ad300) 00010000:00010000:1.0:1788568740.458283:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568740.458288:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a16fc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.458295:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a16fc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788568740.458306:0:6714:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000606ce56 reply state 000000003d1de960 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1703 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568740.458314:0:6714:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788568740.458350:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a16f5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becca expref: 18 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.458363:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a170a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becca expref: 17 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.458371:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae25820c600) 00010000:00010000:1.0:1788568740.458373:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788568740.458375:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2c600, rc 0) 00000100:00100000:1.0:1788568740.458455:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bcbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+18:11360:x1875449958432896:12345-192.168.206.4@tcp:101:bash.0 Request processed in 1361us (1585us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1788568740.458464:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 143 00000100:00100000:0.0:1788568740.471634:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00010000:00010000:1.0:1788568740.471750:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1703 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.471762:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1703 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.471786:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1703 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.471792:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2de00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568740.471797:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1703 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.471805:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1703 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.471821:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ae25820ca00) 00010000:00010000:1.0:1788568740.471824:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568740.471828:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1703 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.471834:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1703 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568740.474730:0:8111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958433024 00000100:00100000:3.0:1788568740.474747:0:8111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958433024 00000100:00100000:3.0:1788568740.474831:0:8111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 47 00000100:00100000:3.0:1788568740.474841:0:8111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2364:x1875449958433024:12345-192.168.206.4@tcp:101:bash.0 00010000:00010000:3.0:1788568740.474877:0:8111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568740.474915:0:8111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df231d3b/0x41e82f464b6a1718 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9becd1 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788568740.474960:0:8111:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788568740.474979:0:8111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=374s v=(0 0) 00010000:00010000:3.0:1788568740.474983:0:8111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788568740.474993:0:8111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df231d3b/0x41e82f464b6a1718 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becd1 expref: 6 pid: 8111 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.475014:0:8111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000df231d3b/0x41e82f464b6a1718 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becd1 expref: 6 pid: 8111 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.475027:0:8111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429de600, rc 0) 00000100:00100000:3.0:1788568740.475088:0:8111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2364:x1875449958433024:12345-192.168.206.4@tcp:101:bash.0 Request processed in 249us (3464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568740.475095:0:8111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 47 00000100:00100000:1.0:1788568740.478586:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568740.478671:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958433152 00000100:00100000:3.0:1788568740.478680:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958433152 00000100:00100000:3.0:1788568740.478738:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 48 00000100:00100000:3.0:1788568740.478748:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+6:11360:x1875449958433152:12345-192.168.206.4@tcp:101:bash.0 00010000:00010000:3.0:1788568740.478765:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568740.478782:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009b2c869/0x41e82f464b6a171f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9becd8 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.478811:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000df231d3b/0x41e82f464b6a1718 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becd1 expref: 7 pid: 8111 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.478837:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788568740.478841:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788568740.478855:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009b2c869/0x41e82f464b6a171f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becd8 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.478891:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000df231d3b/0x41e82f464b6a1718 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becd1 expref: 7 pid: 8111 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.478905:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000df231d3b/0x41e82f464b6a1718 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becd1 expref: 7 pid: 8111 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568740.478918:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b681500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1875449976268032:192.168.206.4@tcp:104: 00000100:00100000:3.0:1788568740.479028:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae25042a900 going to sleep for 11 seconds 00000100:00080000:0.0:1788568740.479271:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788568740.484260:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b681500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1875449976268032:192.168.206.4@tcp:104: 00010000:00010000:3.0:1788568740.484296:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009b2c869/0x41e82f464b6a171f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becd8 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.484317:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429de800, rc 0) 00000100:00100000:3.0:1788568740.484376:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+7:11360:x1875449958433152:12345-192.168.206.4@tcp:101:bash.0 Request processed in 5629us (5798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568740.484385:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 48 00000100:00100000:0.0:1788568740.492770:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568740.492869:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958433280 00000100:00100000:3.0:1788568740.492879:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958433280 00010000:00010000:3.0:1788568740.492920:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000df231d3b/0x41e82f464b6a1718 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becd1 expref: 7 pid: 8111 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568740.493013:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 61 00000100:00100000:3.0:1788568740.493024:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+7:2364:x1875449958433280:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788568740.493039:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568740.493059:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000df231d3b/0x41e82f464b6a1718 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becd1 expref: 7 pid: 8111 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.493087:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000df231d3b/0x41e82f464b6a1718 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becd1 expref: 7 pid: 8111 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.493111:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df231d3b/0x41e82f464b6a1718 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becd1 expref: 7 pid: 8111 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.493144:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788568740.493149:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788568740.493158:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009b2c869/0x41e82f464b6a171f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becd8 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.493171:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009b2c869/0x41e82f464b6a171f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becd8 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.493215:0:6705:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000009b2c869/0x41e82f464b6a171f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becd8 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568740.493229:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b681500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6705:1875449976268160:192.168.206.4@tcp:105: 00000100:00100000:3.0:1788568740.493318:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae25042a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788568740.501192:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568740.501273:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958433536 00000100:00100000:0.0:1788568740.501296:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958433536 00000100:00100000:0.0:1788568740.501355:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 36 00000100:00100000:0.0:1788568740.501366:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+17:11360:x1875449958433536:12345-192.168.206.4@tcp:35:bash.0 00000100:00100000:0.0:1788568740.501696:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+18:11360:x1875449958433536:12345-192.168.206.4@tcp:35:bash.0 Request processed in 331us (511us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1788568740.501704:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 36 00000100:00100000:3.0:1788568740.502599:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b681500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6705:1875449976268160:192.168.206.4@tcp:105: 00010000:00010000:3.0:1788568740.502621:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788568740.502663:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2364:x1875449958433280:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 9642us (9905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568740.502672:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 61 00000100:00100000:1.0:1788568740.628656:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568740.628890:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958433792 00000100:00100000:3.0:1788568740.628900:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958433792 00000100:00100000:3.0:1788568740.628994:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 144 00000100:00100000:3.0:1788568740.629005:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+18:11370:x1875449958433792:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:3.0:1788568740.629031:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568740.629053:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1726 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9becdf expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788568740.629154:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788568740.629273:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1726 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becdf expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.629289:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae2430ad100) 00010000:00010000:3.0:1788568740.629292:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788568740.629298:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1726 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becdf expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.629314:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429de600, rc 0) 00000100:00100000:3.0:1788568740.629378:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+19:11370:x1875449958433792:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 374us (730us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1788568740.629385:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 144 00000100:00100000:2.0:1788568740.638191:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568740.638294:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958434048 00000100:00100000:0.0:1788568740.638303:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958434048 00000100:00100000:0.0:1788568740.638361:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 37 00000100:00100000:0.0:1788568740.638372:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bcbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+19:11370:x1875449958434048:12345-192.168.206.4@tcp:35:lfs.0 00000100:00100000:0.0:1788568740.638624:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bcbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+20:11370:x1875449958434048:12345-192.168.206.4@tcp:35:lfs.0 Request processed in 253us (441us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1788568740.638632:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 37 00000100:00100000:2.0:1788568740.777025:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568740.777143:0:12276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958434176 00000100:00100000:1.0:1788568740.777153:0:12276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958434176 00000100:00100000:1.0:1788568740.777213:0:12276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 145 00000100:00100000:1.0:1788568740.777223:0:12276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bcbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27f83c0c-e36b-48ce-9485-80051fd252dc+20:11376:x1875449958434176:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:1.0:1788568740.777246:0:12276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568740.777265:0:12276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1734 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bece6 expref: -99 pid: 12276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.777357:0:12276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a173b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.777373:0:12276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a173b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.777386:0:12276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a173b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568740.777416:0:12276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788568740.777419:0:12276:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788568740.777435:0:12276:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a173b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.777459:0:12276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1734 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bece6 expref: 22 pid: 12276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.777478:0:12276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a173b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bece6 expref: 21 pid: 12276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.777488:0:12276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ae2430ad300) 00010000:00010000:1.0:1788568740.777490:0:12276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788568740.777494:0:12276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2dc00, rc 0) 00000100:00100000:1.0:1788568740.777559:0:12276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bcbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27f83c0c-e36b-48ce-9485-80051fd252dc+21:11376:x1875449958434176:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 336us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568740.777566:0:12276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 145 00000100:00100000:2.0:1788568740.784796:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568740.784899:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958434432 00000100:00100000:0.0:1788568740.784908:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958434432 00000100:00100000:0.0:1788568740.784997:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 146 00000100:00100000:0.0:1788568740.785007:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bcbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+21:11376:x1875449958434432:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:0.0:1788568740.785027:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568740.785049:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1742 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beced expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568740.785165:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1749 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568740.785181:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1749 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568740.785193:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1749 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788568740.785218:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788568740.785632:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1742 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beced expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568740.785653:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1749 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beced expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568740.785663:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae25820c600) 00010000:00010000:0.0:1788568740.785666:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788568740.785670:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae27feaa400, rc 0) 00000100:00100000:0.0:1788568740.785730:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bcbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+23:11376:x1875449958434432:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 723us (942us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1788568740.785738:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 146 00000100:00100000:3.0:1788568740.794686:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568740.794784:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958434688 00000100:00100000:0.0:1788568740.794795:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958434688 00000100:00100000:0.0:1788568740.794866:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 147 00000100:00100000:0.0:1788568740.794876:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+23:11376:x1875449958434688:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:0.0:1788568740.794900:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568740.794919:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1757 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9becf4 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568740.795037:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a175e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568740.795052:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a175e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568740.795088:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a175e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788568740.795101:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788568740.795229:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1757 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becf4 expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568740.795247:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a175e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becf4 expref: 25 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568740.795256:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae25820c600) 00010000:00010000:0.0:1788568740.795259:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788568740.795263:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae27feabe00, rc 0) 00000100:00100000:0.0:1788568740.795324:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+25:11376:x1875449958434688:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 449us (646us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1788568740.795341:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 147 00000100:00100000:2.0:1788568740.796324:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568740.796461:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958434816 00000100:00100000:1.0:1788568740.796469:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958434816 00000100:00100000:1.0:1788568740.796530:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 10 00000100:00100000:1.0:1788568740.796539:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bcbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+25:2363:x1875449958434816:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788568740.796553:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788568740.796571:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1749 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beced expref: 25 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.796586:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae25820c600) 00010000:00010000:1.0:1788568740.796591:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788568740.796635:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bcbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+24:2363:x1875449958434816:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 97us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568740.796643:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 10 00000100:00100000:2.0:1788568740.803653:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568740.803735:0:8111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958434944 00000100:00100000:3.0:1788568740.803744:0:8111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958434944 00000100:00100000:3.0:1788568740.803804:0:8111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 49 00000100:00100000:3.0:1788568740.803815:0:8111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bcbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2361:x1875449958434944:12345-192.168.206.4@tcp:1:lfs.0 00010000:00010000:3.0:1788568740.803870:0:8111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df231d3b/0x41e82f464b6a176c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.803890:0:8111:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009b2c869/0x41e82f464b6a171f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becd8 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.803900:0:8111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788568740.803904:0:8111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788568740.803909:0:8111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df231d3b/0x41e82f464b6a176c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.803964:0:8111:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009b2c869/0x41e82f464b6a171f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becd8 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568740.803979:0:8111:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009b2c869/0x41e82f464b6a171f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becd8 expref: 6 pid: 6691 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568740.803993:0:8111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b680700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8111:1875449976268288:192.168.206.4@tcp:104: 00000100:00100000:3.0:1788568740.804087:0:8111:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae25042a900 going to sleep for 11 seconds 00000100:00100000:3.0:1788568740.806562:0:8111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b680700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8111:1875449976268288:192.168.206.4@tcp:104: 00010000:00010000:3.0:1788568740.806592:0:8111:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000df231d3b/0x41e82f464b6a176c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568740.811513:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568740.811624:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958435072 00000100:00100000:0.0:1788568740.811634:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958435072 00002000:00100000:0.0:1788568740.811681:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9ae27bcbe300 x1875449958435072/t0(0) o4->27f83c0c-e36b-48ce-9485-80051fd252dc@192.168.206.4@tcp:176/0 lens 504/0 e 0 to 0 dl 1788568751 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788568740.811692:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae27bcbe300 with x1875449958435072 ext(0->12) 00010000:00010000:0.0:1788568740.811703:0:6696:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000009b2c869/0x41e82f464b6a171f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becd8 expref: 7 pid: 6691 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568740.811720:0:6696:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000009b2c869/0x41e82f464b6a171f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becd8 expref: 7 pid: 6691 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788568740.811741:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ae27bcbe300 00000100:00100000:0.0:1788568740.811777:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 2 00000100:00100000:0.0:1788568740.811787:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bcbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+7:2363:x1875449958435072:12345-192.168.206.4@tcp:4:lfs.0 00000100:00100000:0.0:1788568740.812304:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bcbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+9:2363:x1875449958435072:12345-192.168.206.4@tcp:4:lfs.0 Request processed in 516us (799us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788568740.812313:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 2 00002000:00100000:0.0:1788568740.812320:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9ae27bcbe300 x1875449958435072/t4294967305(0) o4->27f83c0c-e36b-48ce-9485-80051fd252dc@192.168.206.4@tcp:176/0 lens 504/448 e 0 to 0 dl 1788568751 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788568740.812338:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae27bcbe300 with x1875449958435072 ext(0->12) 00010000:00010000:0.0:1788568740.812345:0:6696:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000009b2c869/0x41e82f464b6a171f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becd8 expref: 9 pid: 6691 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568740.812358:0:6696:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000009b2c869/0x41e82f464b6a171f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becd8 expref: 9 pid: 6691 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788568740.812365:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ae27bcbe300 00000100:00100000:2.0:1788568740.821611:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568740.821706:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958435200 00000100:00100000:1.0:1788568740.821716:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958435200 00010000:00010000:1.0:1788568740.821752:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009b2c869/0x41e82f464b6a171f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becd8 expref: 9 pid: 6691 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568740.821795:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 62 00000100:00100000:1.0:1788568740.821805:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bcbc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+9:2363:x1875449958435200:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788568740.821822:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788568740.821839:0:5827:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788568740.821842:0:5827:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788568739 00002000:00010000:1.0:1788568740.821855:0:5827:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788568739 00002000:00010000:1.0:1788568740.821857:0:5827:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788568739 00010000:00010000:1.0:1788568740.821863:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009b2c869/0x41e82f464b6a171f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becd8 expref: 9 pid: 6691 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.821896:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009b2c869/0x41e82f464b6a171f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becd8 expref: 9 pid: 6691 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.821922:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009b2c869/0x41e82f464b6a171f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becd8 expref: 9 pid: 6691 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.821966:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788568740.821971:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788568740.821977:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000df231d3b/0x41e82f464b6a176c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.821987:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df231d3b/0x41e82f464b6a176c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.822024:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788568740.822188:0:8111:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000df231d3b/0x41e82f464b6a176c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568740.822198:0:8111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df231d3b/0x41e82f464b6a176c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568740.822224:0:8111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df231d3b/0x41e82f464b6a176c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568740.822232:0:8111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df231d3b/0x41e82f464b6a176c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568740.822239:0:8111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df231d3b/0x41e82f464b6a176c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568740.822246:0:8111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429de600 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:2.0:1788568740.822250:0:8111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df231d3b/0x41e82f464b6a176c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568740.822258:0:8111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df231d3b/0x41e82f464b6a176c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568740.822269:0:8111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df231d3b/0x41e82f464b6a176c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568740.822276:0:8111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df231d3b/0x41e82f464b6a176c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568740.822358:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bcbc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+8:2363:x1875449958435200:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 553us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568740.822367:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 62 00000100:00100000:2.0:1788568740.826451:0:8111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bcbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+7:2361:x1875449958434944:12345-192.168.206.4@tcp:1:lfs.0 Request processed in 22625us (22793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568740.826467:0:8111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 49 00000100:00100000:2.0:1788568740.835920:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568740.836785:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958435456 00000100:00100000:0.0:1788568740.836795:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958435456 00000100:00100000:0.0:1788568740.837029:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 38 00000100:00100000:0.0:1788568740.837042:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24926d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+24:11376:x1875449958435456:12345-192.168.206.4@tcp:35:lfs.0 00000004:00010000:0.0:1788568740.837130:0:5846:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a175e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becf4 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788568740.837574:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1788568740.837633:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1788568740.838462:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1788568740.838524:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1773 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568740.838543:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a170a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becca expref: 28 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568740.838552:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1773 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568740.838590:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a170a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becca expref: 28 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568740.838607:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a170a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becca expref: 28 pid: 6714 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568740.838623:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1875449976268416:192.168.206.4@tcp:104: 00000100:00100000:0.0:1788568740.838714:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae244836840 going to sleep for 11 seconds 00000100:00100000:2.0:1788568740.844637:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1875449976268416:192.168.206.4@tcp:104: 00010000:00010000:2.0:1788568740.844666:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1773 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568740.845908:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568740.846311:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958435584 00000100:00100000:1.0:1788568740.846320:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958435584 00010000:00010000:1.0:1788568740.846369:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a170a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becca expref: 29 pid: 6714 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568740.846409:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 63 00000100:00100000:1.0:1788568740.846419:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bcbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+29:2364:x1875449958435584:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788568740.846448:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788568740.846456:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a170a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becca expref: 29 pid: 6714 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.846469:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a170a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becca expref: 29 pid: 6714 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.846491:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a170a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becca expref: 29 pid: 6714 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.846507:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae25820c600) 00010000:00010000:1.0:1788568740.846513:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1773 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.846523:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1773 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.846531:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1773 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.846561:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788568740.846620:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bcbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+28:2364:x1875449958435584:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 202us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568740.846628:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 63 00010000:00010000:2.0:1788568740.847205:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1773 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568740.847216:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1773 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788568740.847338:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1788568740.847518:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1788568740.847617:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bcbd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1875449976268544:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788568740.847666:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568740.847703:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2526e19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788568740.847820:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976268544 00000100:00100000:3.0:1788568740.847829:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976268544 00000100:00100000:3.0:1788568740.847895:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788568740.847904:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bcbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1875449976268544:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788568740.848013:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bcbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1875449976268544:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 109us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568740.848019:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788568740.848207:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788568740.848295:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bcbd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1875449976268544:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788568740.848745:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1788568740.848802:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bcbd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1875449976268672:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788568740.848866:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568740.848896:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2526e1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788568740.849081:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976268672 00000100:00100000:0.0:1788568740.849087:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976268672 00000100:00100000:0.0:1788568740.849118:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788568740.849137:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1875449976268672:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788568740.849285:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5846:x1875449976268672:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 148us (419us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788568740.849292:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788568740.849590:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bcbd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1875449976268672:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788568740.849645:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1788568740.849684:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1773 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568740.849694:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1773 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568740.849702:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1773 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568740.849708:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feab000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568740.849713:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1773 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568740.849722:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1773 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568740.849738:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae25820c600) 00010000:00010000:2.0:1788568740.849741:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788568740.849745:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1773 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568740.849753:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1773 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788568740.851702:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788568740.851819:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1788568740.851832:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 375259904781ns, next at 376259901286ns, rc = 0 00000001:00080000:2.0:1788568740.851841:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1788568740.853660:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae25820c600) 00010000:00010000:2.0:1788568740.853672:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788568740.853696:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a175e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becf4 expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568740.853956:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24926d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+31:11376:x1875449958435456:12345-192.168.206.4@tcp:35:lfs.0 Request processed in 16916us (18042us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1788568740.853968:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 38 00000020:00080000:2.0:1788568740.853974:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788568740.866619:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568740.869451:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958435712 00000100:00100000:1.0:1788568740.869464:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958435712 00000100:00100000:1.0:1788568740.869573:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 148 00000100:00100000:1.0:1788568740.869585:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+31:11376:x1875449958435712:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:1.0:1788568740.869626:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568740.869648:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a177a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9becfb expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.869699:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a177a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becfb expref: 32 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.869714:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a177a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becfb expref: 32 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568740.869732:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae25820c400) 00010000:00010000:1.0:1788568740.869735:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788568740.869739:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2c600, rc 0) 00000100:00100000:1.0:1788568740.869800:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+32:11376:x1875449958435712:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 218us (3192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568740.869808:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 148 00000100:00100000:0.0:1788568740.873914:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568740.874638:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958435968 00000100:00100000:1.0:1788568740.874648:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958435968 00000100:00100000:1.0:1788568740.874732:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 39 00000100:00100000:1.0:1788568740.874742:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+32:11376:x1875449958435968:12345-192.168.206.4@tcp:35:lfs.0 00000100:00100000:1.0:1788568740.875064:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+33:11376:x1875449958435968:12345-192.168.206.4@tcp:35:lfs.0 Request processed in 322us (1158us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1788568740.875072:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 39 00000100:00100000:2.0:1788568741.016042:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568741.016162:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958436224 00000100:00100000:0.0:1788568741.016185:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958436224 00000100:00100000:0.0:1788568741.016246:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 149 00000100:00100000:0.0:1788568741.016255:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+33:11386:x1875449958436224:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:0.0:1788568741.016277:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568741.016298:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1781 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bed02 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788568741.016381:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788568741.016496:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1781 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed02 expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568741.016510:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae2430ad100) 00010000:00010000:0.0:1788568741.016513:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788568741.016519:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1781 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed02 expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568741.016532:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae27feaa400, rc 0) 00000100:00100000:0.0:1788568741.016754:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+34:11386:x1875449958436224:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 499us (721us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1788568741.016762:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 149 00000100:00100000:0.0:1788568741.021527:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568741.021630:0:12276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958436352 00000100:00100000:1.0:1788568741.021640:0:12276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958436352 00000100:00100000:1.0:1788568741.021700:0:12276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 150 00000100:00100000:1.0:1788568741.021713:0:12276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27f83c0c-e36b-48ce-9485-80051fd252dc+34:11386:x1875449958436352:12345-192.168.206.4@tcp:34:lfs.0 00010000:00010000:1.0:1788568741.021803:0:12276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a178f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.021820:0:12276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a178f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.021833:0:12276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a178f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.021856:0:12276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1796 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.021864:0:12276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1796 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.021870:0:12276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1796 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.021995:0:12276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a179d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.022016:0:12276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a179d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.022024:0:12276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a179d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788568741.022063:0:12276:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a179d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.022075:0:12276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a178f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.022094:0:12276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a178f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.022102:0:12276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a178f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.022108:0:12276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2d600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568741.022113:0:12276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a178f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.022138:0:12276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a178f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.022152:0:12276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ae2430ad300) 00010000:00010000:1.0:1788568741.022154:0:12276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568741.022159:0:12276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a178f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.022165:0:12276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a178f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.022177:0:12276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1796 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.022184:0:12276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1796 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.022190:0:12276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1796 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.022194:0:12276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2ca00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568741.022204:0:12276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1796 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.022209:0:12276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1796 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.022217:0:12276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ae25820cf00) 00010000:00010000:1.0:1788568741.022220:0:12276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568741.022222:0:12276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1796 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.022228:0:12276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1796 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.022243:0:12276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a179d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.022248:0:12276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a179d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.022254:0:12276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a179d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.022258:0:12276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2c000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568741.022262:0:12276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a179d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.022267:0:12276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a179d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.022273:0:12276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae25820c400) 00010000:00010000:1.0:1788568741.022275:0:12276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568741.022284:0:12276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a179d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.022289:0:12276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a179d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568741.022351:0:12276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27f83c0c-e36b-48ce-9485-80051fd252dc+34:11386:x1875449958436352:12345-192.168.206.4@tcp:34:lfs.0 Request processed in 641us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568741.022359:0:12276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 150 00000100:00100000:2.0:1788568741.026906:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568741.027679:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958436608 00000100:00100000:0.0:1788568741.027690:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958436608 00000100:00100000:0.0:1788568741.027788:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 40 00000100:00100000:0.0:1788568741.027798:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+34:11386:x1875449958436608:12345-192.168.206.4@tcp:35:lfs.0 00000100:00100000:0.0:1788568741.028201:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+35:11386:x1875449958436608:12345-192.168.206.4@tcp:35:lfs.0 Request processed in 403us (1303us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1788568741.028225:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 40 00010000:00010000:0.0:1788568741.047791:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568741.081693:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568741.081793:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958436864 00000100:00100000:1.0:1788568741.081802:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958436864 00000100:00100000:1.0:1788568741.081867:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 151 00000100:00100000:1.0:1788568741.081877:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+35:11389:x1875449958436864:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:1.0:1788568741.081900:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568741.081920:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a17a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bed09 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.082064:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a17ab lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.082095:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a17ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.082108:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a17ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.082139:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a17b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.082146:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a17b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.082164:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a17b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.082283:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a17b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.082291:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a17b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.082298:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a17b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568741.082307:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788568741.082403:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a17ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.082410:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a17ab lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.082417:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a17ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.082423:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2ca00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568741.082427:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a17ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.082436:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a17ab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.082449:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ae2430ad300) 00010000:00010000:1.0:1788568741.082453:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568741.082468:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a17ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.082476:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a17ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.082493:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a17b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.082501:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a17b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.082507:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a17b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.082512:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2d600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568741.082515:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a17b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.082521:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a17b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.082529:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ae25820cf00) 00010000:00010000:1.0:1788568741.082531:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568741.082534:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a17b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.082540:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a17b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.082580:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a17a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed09 expref: 38 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.082606:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a17b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed09 expref: 37 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.082613:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae25820c400) 00010000:00010000:1.0:1788568741.082615:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788568741.082617:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2c200, rc 0) 00000100:00100000:1.0:1788568741.082682:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+37:11389:x1875449958436864:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 806us (998us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1788568741.082690:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 151 00000100:00100000:2.0:1788568741.087864:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568741.087975:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958436992 00000100:00100000:0.0:1788568741.087988:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958436992 00000100:00100000:0.0:1788568741.088041:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 152 00000100:00100000:0.0:1788568741.088052:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+37:11389:x1875449958436992:12345-192.168.206.4@tcp:54:lfs.0 00010000:00010000:0.0:1788568741.088142:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a17c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568741.088159:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a17c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568741.088172:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a17c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568741.088197:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a17c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568741.088204:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a17c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568741.088212:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a17c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568741.088218:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaa400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568741.088222:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a17c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568741.088230:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a17c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568741.088259:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae25820c400) 00010000:00010000:0.0:1788568741.088262:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788568741.088267:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a17c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568741.088275:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a17c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568741.088345:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+37:11389:x1875449958436992:12345-192.168.206.4@tcp:54:lfs.0 Request processed in 294us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568741.088352:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 152 00000100:00100000:2.0:1788568741.091288:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568741.091381:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958437248 00000100:00100000:1.0:1788568741.091392:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958437248 00000100:00100000:1.0:1788568741.091448:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 41 00000100:00100000:1.0:1788568741.091459:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+37:11389:x1875449958437248:12345-192.168.206.4@tcp:35:lfs.0 00000100:00100000:1.0:1788568741.091698:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+38:11389:x1875449958437248:12345-192.168.206.4@tcp:35:lfs.0 Request processed in 240us (419us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1788568741.091706:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 41 00000100:00100000:2.0:1788568741.396864:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568741.396909:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568741.396977:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568741.397004:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568741.397026:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568741.397163:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958437504 00000100:00100000:0.0:1788568741.397173:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958437504 00000100:00100000:0.0:1788568741.397225:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958437888 00000100:00100000:0.0:1788568741.397228:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958437888 00000100:00100000:0.0:1788568741.397250:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 155 00000100:00100000:0.0:1788568741.397259:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+38:2361:x1875449958437504:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:0.0:1788568741.397332:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+38:2361:x1875449958437504:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 73us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568741.397339:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 155 00000100:00100000:0.0:1788568741.397356:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 156 00000100:00100000:0.0:1788568741.397362:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2361:x1875449958437888:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:0.0:1788568741.397386:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2361:x1875449958437888:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 24us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568741.397391:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 156 00000100:00100000:3.0:1788568741.397463:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958437376 00000100:00100000:3.0:1788568741.397467:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958437376 00000100:00100000:3.0:1788568741.397502:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 295 00000100:00100000:3.0:1788568741.397509:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae250448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+13:2361:x1875449958437376:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:3.0:1788568741.397545:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae250448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+13:2361:x1875449958437376:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 36us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568741.397550:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 295 00000100:00100000:3.0:1788568741.397576:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958437760 00000100:00100000:3.0:1788568741.397579:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958437760 00000100:00100000:3.0:1788568741.397600:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958437632 00000100:00100000:3.0:1788568741.397602:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958437632 00000100:00100000:3.0:1788568741.397623:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 91 00000100:00100000:3.0:1788568741.397629:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+7:2361:x1875449958437760:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:3.0:1788568741.397651:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+7:2361:x1875449958437760:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 22us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568741.397656:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 91 00000100:00100000:3.0:1788568741.397666:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 92 00000100:00100000:3.0:1788568741.397671:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2361:x1875449958437632:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:3.0:1788568741.397707:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2361:x1875449958437632:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 35us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568741.397714:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 92 00000100:00080000:0.0:1788568741.397837:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788568741.416081:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568741.416186:0:12276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958438144 00000100:00100000:1.0:1788568741.416196:0:12276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958438144 00000100:00100000:1.0:1788568741.416256:0:12276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 153 00000100:00100000:1.0:1788568741.416268:0:12276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27f83c0c-e36b-48ce-9485-80051fd252dc+38:11419:x1875449958438144:12345-192.168.206.4@tcp:101:cat.0 00010000:00010000:1.0:1788568741.416287:0:12276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568741.416307:0:12276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a17ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bed10 expref: -99 pid: 12276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.416410:0:12276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a17d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.416436:0:12276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a17d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.416446:0:12276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a17d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568741.416457:0:12276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788568741.416572:0:12276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a17ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed10 expref: 41 pid: 12276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.416590:0:12276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a17d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed10 expref: 40 pid: 12276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.416597:0:12276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae25820c400) 00010000:00010000:1.0:1788568741.416600:0:12276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788568741.416603:0:12276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2d600, rc 0) 00000100:00100000:1.0:1788568741.416667:0:12276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27f83c0c-e36b-48ce-9485-80051fd252dc+40:11419:x1875449958438144:12345-192.168.206.4@tcp:101:cat.0 Request processed in 401us (606us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1788568741.416673:0:12276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 153 00000100:00100000:2.0:1788568741.419993:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568741.420038:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568741.420144:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958438528 00000100:00100000:0.0:1788568741.420154:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958438528 00000100:00100000:0.0:1788568741.420222:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 11 00000100:00100000:0.0:1788568741.420232:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+40:2364:x1875449958438528:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788568741.420248:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568741.420269:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a17d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed10 expref: 40 pid: 12276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568741.420287:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae25820c400) 00010000:00010000:0.0:1788568741.420292:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788568741.420357:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+39:2364:x1875449958438528:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 127us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568741.420364:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 11 00000100:00100000:1.0:1788568741.421376:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958438400 00000100:00100000:1.0:1788568741.421387:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958438400 00000100:00100000:1.0:1788568741.421426:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 42 00000100:00100000:1.0:1788568741.421434:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+39:11419:x1875449958438400:12345-192.168.206.4@tcp:35:cat.0 00000100:00100000:1.0:1788568741.421682:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+40:11419:x1875449958438400:12345-192.168.206.4@tcp:35:cat.0 Request processed in 248us (1695us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1788568741.421690:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 42 00000100:00100000:2.0:1788568741.512268:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568741.516993:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958438784 00000100:00100000:0.0:1788568741.517008:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958438784 00000100:00100000:0.0:1788568741.517215:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 154 00000100:00100000:0.0:1788568741.517227:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+40:11426:x1875449958438784:12345-192.168.206.4@tcp:101:dd.0 00010000:00010000:0.0:1788568741.517250:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568741.517254:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788568741.517278:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a173b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bece6 expref: 40 pid: 12276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568741.517298:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ae2430ad300) 00010000:00010000:0.0:1788568741.517303:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788568741.517317:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a17e3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bed17 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568741.517427:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a17ea lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568741.517454:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a17b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed09 expref: 40 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568741.517463:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a17ea lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568741.517497:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a17b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed09 expref: 40 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568741.517511:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a17b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed09 expref: 40 pid: 6714 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568741.517525:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875449976268800:192.168.206.4@tcp:104: 00000100:00100000:0.0:1788568741.518950:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae244836180 going to sleep for 11 seconds 00000100:00100000:3.0:1788568741.522584:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568741.522800:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958438912 00000100:00100000:1.0:1788568741.522820:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958438912 00010000:00010000:1.0:1788568741.522874:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a17b9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed09 expref: 41 pid: 6714 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568741.522913:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 64 00000100:00100000:1.0:1788568741.522923:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25319e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+41:2363:x1875449958438912:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788568741.522971:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788568741.522978:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a17b9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed09 expref: 41 pid: 6714 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.522995:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a17b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed09 expref: 41 pid: 6714 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.523020:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae25820c400) 00010000:00010000:1.0:1788568741.523026:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a17ea lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.523037:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a17ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.523045:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a17ea lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.523078:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788568741.523143:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25319e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+41:2363:x1875449958438912:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 220us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568741.523151:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 64 00010000:00010000:0.0:1788568741.524381:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a17b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed09 expref: 40 pid: 6714 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568741.524402:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875449976268800:192.168.206.4@tcp:104: 00010000:00010000:0.0:1788568741.524424:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a17ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568741.524434:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a17ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568741.524440:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a17ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788568741.524459:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788568741.524636:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a17e3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed17 expref: 41 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568741.524652:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a17ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed17 expref: 40 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568741.524661:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae25820c400) 00010000:00010000:0.0:1788568741.524663:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788568741.524667:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae27feabe00, rc 0) 00000100:00100000:0.0:1788568741.524709:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+40:11426:x1875449958438784:12345-192.168.206.4@tcp:101:dd.0 Request processed in 7485us (12450us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1788568741.524717:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 154 00000100:00100000:1.0:1788568741.540517:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568741.540734:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958439168 00000100:00100000:2.0:1788568741.540744:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958439168 00000100:00100000:2.0:1788568741.540804:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 155 00000100:00100000:2.0:1788568741.540814:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+40:11426:x1875449958439168:12345-192.168.206.4@tcp:36:dd.0 00010000:00010000:2.0:1788568741.541153:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a17f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568741.541191:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a17f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568741.541204:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a17f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788568741.541256:0:6714:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1788568741.541279:0:6714:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009915a9d8 reply state 0000000072f06217 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a17f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568741.541286:0:6714:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788568741.541704:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+43:11426:x1875449958439168:12345-192.168.206.4@tcp:36:dd.0 Request processed in 888us (1194us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788568741.541712:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 155 00000020:00080000:2.0:1788568741.541717:0:6714:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788568741.547860:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a17f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568741.547876:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a17f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568741.547883:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a17f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568741.547888:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7ae00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568741.547892:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a17f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568741.547899:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a17f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568741.547915:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae25820c400) 00010000:00010000:3.0:1788568741.547919:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788568741.547923:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a17f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568741.547958:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a17f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568741.862770:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568741.863685:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958439296 00000100:00100000:0.0:1788568741.863697:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958439296 00000100:00100000:0.0:1788568741.863828:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 156 00000100:00100000:0.0:1788568741.863840:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+42:11440:x1875449958439296:12345-192.168.206.4@tcp:101:stat.0 00010000:00010000:0.0:1788568741.863878:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568741.863901:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a17ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bed1e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568741.863981:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1806 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568741.863996:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1806 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568741.864010:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1806 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568741.864043:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a180d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568741.864051:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a180d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568741.864059:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a180d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568741.864334:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1814 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568741.864348:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a17ea lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed17 expref: 43 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568741.864357:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1814 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568741.864392:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a17ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed17 expref: 43 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568741.864407:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a17ea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed17 expref: 43 pid: 5843 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568741.864423:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875449976268928:192.168.206.4@tcp:104: 00000100:00100000:0.0:1788568741.864569:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae244836f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788568741.873096:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568741.873423:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958439552 00000100:00100000:3.0:1788568741.873433:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958439552 00000100:00100000:3.0:1788568741.873507:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 43 00000100:00100000:3.0:1788568741.873518:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+44:5599:x1875449958439552:12345-192.168.206.4@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788568741.873837:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+45:5599:x1875449958439552:12345-192.168.206.4@tcp:35:ldlm_bl.0 Request processed in 320us (749us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1788568741.873853:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 43 00000100:00100000:0.0:1788568741.874327:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875449976268928:192.168.206.4@tcp:104: 00010000:00010000:0.0:1788568741.874351:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1814 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568741.883610:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568741.883982:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958439680 00000100:00100000:0.0:1788568741.883992:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958439680 00010000:00010000:0.0:1788568741.884044:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a17ea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed17 expref: 45 pid: 5843 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568741.884090:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 65 00000100:00100000:0.0:1788568741.884101:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+45:2363:x1875449958439680:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788568741.884124:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568741.884131:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a17ea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed17 expref: 45 pid: 5843 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568741.884145:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a17ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed17 expref: 45 pid: 5843 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568741.884167:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a17ea lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed17 expref: 45 pid: 5843 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568741.884183:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae25820c400) 00010000:00010000:0.0:1788568741.884187:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1814 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568741.884198:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1814 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568741.884205:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1814 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568741.884244:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788568741.884320:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+44:2363:x1875449958439680:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 221us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568741.884328:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 65 00010000:00010000:1.0:1788568741.884453:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1814 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.884462:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1814 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568741.884509:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788568741.884513:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788568741.884535:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1814 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.884547:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1814 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.884557:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1806 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.884564:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1806 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.884572:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1806 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.884578:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaa200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568741.884589:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1806 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.884598:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1806 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.884608:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ae2430ad300) 00010000:00010000:1.0:1788568741.884610:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568741.884622:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1806 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.884629:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1806 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.884642:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a180d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.884648:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a180d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.884654:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a180d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.884660:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaa800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568741.884663:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a180d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.884669:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a180d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.884677:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ae24515a500) 00010000:00010000:1.0:1788568741.884679:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568741.884682:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a180d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.884688:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a180d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.884721:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a17ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed1e expref: 44 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.884748:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1814 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed1e expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.884755:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae25820c400) 00010000:00010000:1.0:1788568741.884758:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788568741.884760:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae27feab000, rc 0) 00000100:00100000:1.0:1788568741.884788:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+43:11440:x1875449958439296:12345-192.168.206.4@tcp:101:stat.0 Request processed in 20951us (22027us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568741.884795:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 156 00000100:00100000:1.0:1788568741.976112:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568741.976219:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958439936 00000100:00100000:0.0:1788568741.976229:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958439936 00000100:00100000:0.0:1788568741.976286:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 157 00000100:00100000:0.0:1788568741.976297:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bed2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+43:11447:x1875449958439936:12345-192.168.206.4@tcp:36:truncate.0 00010000:00010000:0.0:1788568741.976351:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568741.976379:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1814 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed1e expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568741.976399:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae25820c400) 00010000:00010000:0.0:1788568741.976404:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788568741.976612:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a181b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568741.976626:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a181b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568741.976637:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a181b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788568741.976689:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1788568741.976714:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e5db06a reply state 00000000d8084343 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a181b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568741.976723:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788568741.976824:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bed2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+45:11447:x1875449958439936:12345-192.168.206.4@tcp:36:truncate.0 Request processed in 528us (719us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1788568741.976832:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 157 00000020:00080000:0.0:1788568741.976858:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788568741.983158:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a181b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.983176:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a181b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.983184:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a181b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.983190:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feabe00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568741.983195:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a181b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.983202:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a181b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.983219:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae25820c400) 00010000:00010000:1.0:1788568741.983222:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568741.983243:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a181b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568741.983250:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a181b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.071446:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568742.149581:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568742.149699:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958440064 00000100:00100000:2.0:1788568742.149709:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958440064 00000100:00100000:2.0:1788568742.149786:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 158 00000100:00100000:2.0:1788568742.149798:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bed1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+44:11461:x1875449958440064:12345-192.168.206.4@tcp:101:stat.0 00010000:00010000:2.0:1788568742.149822:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568742.149854:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1822 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bed25 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.149915:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1829 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.149960:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1829 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.149972:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1829 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.150001:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1830 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.150009:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1830 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.150016:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1830 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.150105:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1837 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.150124:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1837 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.150132:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1837 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788568742.150162:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1788568742.150167:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788568742.150186:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1837 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.150197:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1837 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.150204:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1829 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.150210:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1829 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.150227:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1829 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.150232:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7aa00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568742.150236:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1829 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.150244:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1829 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.150256:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ae2430ad300) 00010000:00010000:2.0:1788568742.150259:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788568742.150264:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1829 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.150270:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1829 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.150292:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1830 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.150298:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1830 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.150304:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1830 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.150309:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7b600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568742.150312:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1830 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.150328:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1830 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.150337:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ae255fb9b00) 00010000:00010000:2.0:1788568742.150339:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788568742.150342:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1830 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.150348:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1830 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.150381:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1822 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed25 expref: 46 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.150395:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1837 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed25 expref: 45 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.150401:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae25820c400) 00010000:00010000:2.0:1788568742.150403:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788568742.150406:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7ae00, rc 0) 00000100:00100000:2.0:1788568742.150470:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bed1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+45:11461:x1875449958440064:12345-192.168.206.4@tcp:101:stat.0 Request processed in 675us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568742.150478:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 158 00000100:00080000:0.0:1788568742.150556:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788568742.243879:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568742.244040:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958440320 00000100:00100000:1.0:1788568742.244053:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958440320 00000100:00100000:1.0:1788568742.244132:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 159 00000100:00100000:1.0:1788568742.244144:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+45:11471:x1875449958440320:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:1.0:1788568742.244169:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568742.244197:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a183e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bed2c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568742.244323:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788568742.244485:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a183e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed2c expref: 47 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568742.244502:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae2430ad100) 00010000:00010000:1.0:1788568742.244505:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788568742.244512:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a183e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed2c expref: 47 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568742.244529:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2d400, rc 0) 00000100:00100000:1.0:1788568742.244607:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+46:11471:x1875449958440320:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 465us (742us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1788568742.244615:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 159 00000100:00100000:1.0:1788568742.248918:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568742.249183:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958440576 00000100:00100000:3.0:1788568742.249196:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958440576 00000100:00100000:3.0:1788568742.249273:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 44 00000100:00100000:3.0:1788568742.249285:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24926f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+46:11471:x1875449958440576:12345-192.168.206.4@tcp:35:lfs.0 00000100:00100000:3.0:1788568742.249625:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24926f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+47:11471:x1875449958440576:12345-192.168.206.4@tcp:35:lfs.0 Request processed in 342us (721us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1788568742.249634:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 44 00000100:00100000:3.0:1788568742.328992:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568742.329196:0:12276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958440832 00000100:00100000:1.0:1788568742.329210:0:12276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958440832 00000100:00100000:1.0:1788568742.329280:0:12276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 160 00000100:00100000:1.0:1788568742.329292:0:12276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27f83c0c-e36b-48ce-9485-80051fd252dc+47:11477:x1875449958440832:12345-192.168.206.4@tcp:101:bash.0 00010000:00010000:1.0:1788568742.329334:0:12276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568742.329364:0:12276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a184c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bed33 expref: -99 pid: 12276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568742.329554:0:12276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a1853 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568742.329572:0:12276:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1837 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed25 expref: 48 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568742.329582:0:12276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a1853 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568742.329772:0:12276:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1837 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed25 expref: 48 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568742.329789:0:12276:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1837 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed25 expref: 48 pid: 6714 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568742.329806:0:12276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bed1880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12276:1875449976269056:192.168.206.4@tcp:104: 00000100:00100000:1.0:1788568742.330087:0:12276:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2487d39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788568742.336285:0:12276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bed1880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12276:1875449976269056:192.168.206.4@tcp:104: 00010000:00010000:3.0:1788568742.336325:0:12276:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a1853 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568742.339420:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568742.339539:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958440960 00000100:00100000:1.0:1788568742.339552:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958440960 00010000:00010000:1.0:1788568742.339608:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1837 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed25 expref: 49 pid: 6714 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568742.339682:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 66 00000100:00100000:1.0:1788568742.339695:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+49:2364:x1875449958440960:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788568742.339717:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788568742.339725:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1837 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed25 expref: 49 pid: 6714 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568742.339741:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1837 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed25 expref: 49 pid: 6714 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568742.339767:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1837 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed25 expref: 49 pid: 6714 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568742.339802:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae25820c400) 00010000:00010000:1.0:1788568742.339808:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a1853 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568742.339820:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a1853 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568742.339829:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a1853 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568742.339874:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788568742.339989:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+48:2364:x1875449958440960:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 296us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568742.339997:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 66 00010000:00010000:0.0:1788568742.340086:0:12276:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a1853 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.340096:0:12276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a1853 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788568742.340127:0:12276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1788568742.340328:0:12276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a184c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed33 expref: 49 pid: 12276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.340346:0:12276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a1853 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed33 expref: 48 pid: 12276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.340355:0:12276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae25820c400) 00010000:00010000:0.0:1788568742.340358:0:12276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788568742.340360:0:12276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2c200, rc 0) 00000100:00100000:0.0:1788568742.340390:0:12276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27f83c0c-e36b-48ce-9485-80051fd252dc+48:11477:x1875449958440832:12345-192.168.206.4@tcp:101:bash.0 Request processed in 11101us (11415us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1788568742.340398:0:12276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 160 00000100:00100000:1.0:1788568742.346696:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568742.347386:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958441216 00000100:00100000:2.0:1788568742.347401:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958441216 00000100:00100000:2.0:1788568742.347478:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 161 00000100:00100000:2.0:1788568742.347491:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+48:11477:x1875449958441216:12345-192.168.206.4@tcp:36:bash.0 00010000:00010000:2.0:1788568742.348027:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1861 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.348052:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1861 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.348320:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1861 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788568742.348397:0:6714:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1788568742.348429:0:6714:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a4691a3f reply state 000000006bf2c63d transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1861 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568742.348440:0:6714:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788568742.348567:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+51:11477:x1875449958441216:12345-192.168.206.4@tcp:36:bash.0 Request processed in 1075us (1884us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1788568742.348577:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 161 00000020:00080000:2.0:1788568742.348582:0:6714:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788568742.357325:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1861 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.357348:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1861 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.357358:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1861 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.357365:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7aa00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568742.357391:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1861 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.357401:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1861 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.357426:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae25820c400) 00010000:00010000:3.0:1788568742.357429:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788568742.357436:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1861 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.357443:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1861 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568742.362278:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568742.362544:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958441344 00000100:00100000:0.0:1788568742.362558:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958441344 00000100:00100000:0.0:1788568742.362632:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 162 00000100:00100000:0.0:1788568742.362646:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+50:11477:x1875449958441344:12345-192.168.206.4@tcp:101:bash.0 00010000:00010000:0.0:1788568742.362678:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568742.362707:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1868 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bed3a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.362837:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a186f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.362854:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a1853 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed33 expref: 51 pid: 12276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.362865:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a186f lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.362905:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a1853 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed33 expref: 51 pid: 12276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.362956:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a1853 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed33 expref: 51 pid: 12276 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568742.362973:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875449976269184:192.168.206.4@tcp:104: 00000100:00100000:0.0:1788568742.363075:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae244836180 going to sleep for 11 seconds 00000100:00100000:2.0:1788568742.367052:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568742.367410:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875449976269184:192.168.206.4@tcp:104: 00010000:00010000:1.0:1788568742.367449:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a186f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568742.367654:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958441472 00000100:00100000:3.0:1788568742.367663:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958441472 00010000:00010000:3.0:1788568742.367712:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a1853 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed33 expref: 52 pid: 12276 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568742.367758:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 67 00000100:00100000:3.0:1788568742.367769:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+52:2364:x1875449958441472:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788568742.367788:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568742.367796:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a1853 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed33 expref: 52 pid: 12276 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.367809:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a1853 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed33 expref: 52 pid: 12276 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.367835:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a1853 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed33 expref: 52 pid: 12276 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.367887:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae25820c400) 00010000:00010000:3.0:1788568742.367892:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a186f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.367903:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a186f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.367950:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a186f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.367985:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788568742.368053:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+51:2364:x1875449958441472:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 284us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568742.368061:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 67 00010000:00010000:1.0:1788568742.368468:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a186f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568742.368477:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a186f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568742.368534:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788568742.368539:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788568742.368566:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a186f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568742.368604:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1868 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed3a expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568742.368620:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a186f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed3a expref: 50 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568742.368628:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae25820c400) 00010000:00010000:1.0:1788568742.368641:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788568742.368644:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae27feabe00, rc 0) 00000100:00100000:1.0:1788568742.368680:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+50:11477:x1875449958441344:12345-192.168.206.4@tcp:101:bash.0 Request processed in 6038us (6415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568742.368687:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 162 00000100:00100000:1.0:1788568742.373494:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568742.373575:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958441728 00000100:00100000:3.0:1788568742.373588:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958441728 00000100:00100000:3.0:1788568742.373661:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 45 00000100:00100000:3.0:1788568742.373674:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bed1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+50:11477:x1875449958441728:12345-192.168.206.4@tcp:35:bash.0 00000100:00100000:3.0:1788568742.374024:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bed1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+51:11477:x1875449958441728:12345-192.168.206.4@tcp:35:bash.0 Request processed in 351us (543us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1788568742.374032:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 45 00000100:00100000:2.0:1788568742.486659:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568742.486779:0:12276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958441984 00000100:00100000:0.0:1788568742.486792:0:12276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958441984 00000100:00100000:0.0:1788568742.486868:0:12276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 163 00000100:00100000:0.0:1788568742.486882:0:12276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27f83c0c-e36b-48ce-9485-80051fd252dc+51:11487:x1875449958441984:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:0.0:1788568742.486913:0:12276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568742.486973:0:12276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1876 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bed41 expref: -99 pid: 12276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788568742.487109:0:12276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788568742.487297:0:12276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1876 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed41 expref: 53 pid: 12276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.487334:0:12276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae2430ad100) 00010000:00010000:0.0:1788568742.487338:0:12276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788568742.487345:0:12276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1876 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed41 expref: 53 pid: 12276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.487363:0:12276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae27feaa800, rc 0) 00000100:00100000:0.0:1788568742.487688:0:12276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27f83c0c-e36b-48ce-9485-80051fd252dc+52:11487:x1875449958441984:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 808us (1054us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1788568742.487697:0:12276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 163 00000100:00100000:0.0:1788568742.495793:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568742.495983:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958442112 00000100:00100000:2.0:1788568742.495997:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958442112 00000100:00100000:2.0:1788568742.496065:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 164 00000100:00100000:2.0:1788568742.496078:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+52:11487:x1875449958442112:12345-192.168.206.4@tcp:34:lfs.0 00010000:00010000:2.0:1788568742.496254:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1884 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.496277:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1884 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.496293:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1884 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.496328:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a188b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.496337:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a188b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.496344:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a188b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.496461:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1892 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.496471:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.496477:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788568742.496529:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.496544:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1884 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.496551:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1884 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.496560:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1884 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.496566:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7be00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568742.496570:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1884 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.496586:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1884 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.496600:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ae2430ad300) 00010000:00010000:2.0:1788568742.496603:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788568742.496608:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1884 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.496615:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1884 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.497087:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a188b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.497095:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a188b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.497101:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a188b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.497107:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7a200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568742.497110:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a188b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.497127:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a188b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.497210:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ae255fb9b00) 00010000:00010000:2.0:1788568742.497212:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788568742.497216:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a188b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.497235:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a188b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.497257:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.497263:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1892 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.497269:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1892 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.497274:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7a600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568742.497277:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1892 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.497282:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1892 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.497290:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae25820c400) 00010000:00010000:2.0:1788568742.497293:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788568742.497296:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1892 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.497302:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1892 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568742.497455:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+52:11487:x1875449958442112:12345-192.168.206.4@tcp:34:lfs.0 Request processed in 1375us (1671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568742.497464:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 164 00000100:00100000:1.0:1788568742.503266:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568742.503880:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958442368 00000100:00100000:3.0:1788568742.503894:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958442368 00000100:00100000:3.0:1788568742.504594:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 46 00000100:00100000:3.0:1788568742.504610:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+52:11487:x1875449958442368:12345-192.168.206.4@tcp:35:lfs.0 00000100:00100000:3.0:1788568742.504998:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+53:11487:x1875449958442368:12345-192.168.206.4@tcp:35:lfs.0 Request processed in 390us (1745us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1788568742.505022:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 46 00000100:00100000:1.0:1788568742.565166:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568742.565348:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958442624 00000100:00100000:0.0:1788568742.565361:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958442624 00000100:00100000:0.0:1788568742.565444:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 165 00000100:00100000:0.0:1788568742.565458:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+53:11490:x1875449958442624:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:0.0:1788568742.565493:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568742.565522:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1899 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bed48 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.565786:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a18a0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.565804:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a18a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.565818:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a18a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.565916:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a18a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.565963:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a18a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.565971:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a18a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.566451:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a18ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.566462:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a18ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.566471:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a18ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788568742.566483:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788568742.566600:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a18a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.566609:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a18a0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.566617:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a18a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.566623:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaa800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568742.566629:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a18a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.567191:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a18a0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.567207:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ae2430ad300) 00010000:00010000:0.0:1788568742.567210:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788568742.567216:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a18a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.567223:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a18a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.567241:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a18a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.567247:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a18a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.567254:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a18a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.567259:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaa400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568742.567262:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a18a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.567269:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a18a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.567277:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ae24515ac00) 00010000:00010000:0.0:1788568742.567280:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788568742.567283:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a18a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.567300:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a18a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.567370:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1899 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed48 expref: 56 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.567387:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a18ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed48 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.567394:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae25820c400) 00010000:00010000:0.0:1788568742.567397:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788568742.567400:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae27feab000, rc 0) 00000100:00100000:0.0:1788568742.567501:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+55:11490:x1875449958442624:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 2043us (2346us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1788568742.567510:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 165 00000100:00100000:0.0:1788568742.571327:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568742.571423:0:12276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958442752 00000100:00100000:3.0:1788568742.571436:0:12276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958442752 00000100:00100000:3.0:1788568742.571559:0:12276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 166 00000100:00100000:3.0:1788568742.571573:0:12276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27f83c0c-e36b-48ce-9485-80051fd252dc+55:11490:x1875449958442752:12345-192.168.206.4@tcp:54:lfs.0 00010000:00010000:2.0:1788568742.575351:0:12276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a18bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.575382:0:12276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a18bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.575396:0:12276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a18bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.575436:0:12276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a18bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.575445:0:12276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a18bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.575452:0:12276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a18bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.575458:0:12276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7a600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568742.575463:0:12276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a18bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.575472:0:12276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a18bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.575484:0:12276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae25820c400) 00010000:00010000:2.0:1788568742.575488:0:12276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788568742.575493:0:12276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a18bc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.575500:0:12276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a18bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568742.575775:0:12276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27f83c0c-e36b-48ce-9485-80051fd252dc+55:11490:x1875449958442752:12345-192.168.206.4@tcp:54:lfs.0 Request processed in 4197us (4454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568742.575788:0:12276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 166 00000100:00100000:1.0:1788568742.576071:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568742.576141:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958442880 00000100:00100000:0.0:1788568742.576151:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958442880 00000100:00100000:0.0:1788568742.576211:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 12 00000100:00100000:0.0:1788568742.576223:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+55:2364:x1875449958442880:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788568742.576241:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568742.576262:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a18ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed48 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.576275:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae25820c400) 00010000:00010000:0.0:1788568742.576280:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788568742.576330:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+54:2364:x1875449958442880:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 109us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568742.576340:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 12 00000100:00100000:3.0:1788568742.579643:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568742.579816:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958443136 00000100:00100000:1.0:1788568742.579828:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958443136 00000100:00100000:1.0:1788568742.579903:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 47 00000100:00100000:1.0:1788568742.579913:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+54:11490:x1875449958443136:12345-192.168.206.4@tcp:35:lfs.0 00000100:00100000:1.0:1788568742.580256:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+55:11490:x1875449958443136:12345-192.168.206.4@tcp:35:lfs.0 Request processed in 344us (626us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1788568742.580265:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 47 00000040:00080000:0.0:1788568742.647267:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788568742.647279:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788568742.647543:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1788568742.647554:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788568742.736788:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568742.737200:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958443392 00000100:00100000:3.0:1788568742.737215:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958443392 00000100:00100000:3.0:1788568742.737330:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 167 00000100:00100000:3.0:1788568742.737343:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+55:11508:x1875449958443392:12345-192.168.206.4@tcp:101:cat.0 00010000:00010000:3.0:1788568742.737374:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568742.737401:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a18c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bed4f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.737554:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a18ca lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.737572:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a18ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.737587:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a18ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788568742.737600:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788568742.737759:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a18c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed4f expref: 58 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.737783:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a18ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed4f expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.737821:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae25820c400) 00010000:00010000:3.0:1788568742.737824:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788568742.737828:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429df200, rc 0) 00000100:00100000:3.0:1788568742.738270:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+57:11508:x1875449958443392:12345-192.168.206.4@tcp:101:cat.0 Request processed in 926us (1493us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1788568742.738279:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 167 00000100:00100000:3.0:1788568742.781342:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568742.782424:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958443520 00000100:00100000:0.0:1788568742.782442:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958443520 00000100:00100000:0.0:1788568742.782707:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 168 00000100:00100000:0.0:1788568742.782722:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+57:11509:x1875449958443520:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:0.0:1788568742.782753:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568742.782780:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a18d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bed56 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.782886:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a18df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.782905:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a18df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.782919:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a18df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788568742.782982:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788568742.782989:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788568742.783010:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a18df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.783050:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a18d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed56 expref: 59 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.783097:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a18df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed56 expref: 58 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568742.783107:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ae2430ad300) 00010000:00010000:0.0:1788568742.783121:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788568742.783185:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae27feaa200, rc 0) 00000100:00100000:0.0:1788568742.783279:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+58:11509:x1875449958443520:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 560us (1956us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568742.783288:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 168 00000100:00100000:3.0:1788568742.792306:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568742.792726:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958443904 00000100:00100000:2.0:1788568742.792741:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958443904 00000100:00100000:2.0:1788568742.792883:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 48 00000100:00100000:2.0:1788568742.792897:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+58:11509:x1875449958443904:12345-192.168.206.4@tcp:35:lfs.0 00000100:00100000:2.0:1788568742.793398:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+59:11509:x1875449958443904:12345-192.168.206.4@tcp:35:lfs.0 Request processed in 500us (1102us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1788568742.793407:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 48 00000100:00100000:1.0:1788568742.797255:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568742.797414:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958444032 00000100:00100000:3.0:1788568742.797427:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958444032 00000100:00100000:3.0:1788568742.797680:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 13 00000100:00100000:3.0:1788568742.797694:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+59:11509:x1875449958444032:12345-192.168.206.4@tcp:103:lfs.0 00010000:00010000:3.0:1788568742.797715:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788568742.797746:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a186f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed3a expref: 59 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.797772:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a18ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed4f expref: 58 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.797787:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a177a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becfb expref: 57 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.797799:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae25820c400) 00010000:00010000:3.0:1788568742.797811:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788568742.798009:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+56:11509:x1875449958444032:12345-192.168.206.4@tcp:103:lfs.0 Request processed in 318us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568742.798044:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 13 00000100:00100000:1.0:1788568742.801798:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568742.802388:0:12276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958444160 00000100:00100000:2.0:1788568742.802404:0:12276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958444160 00000100:00100000:2.0:1788568742.802516:0:12276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 169 00000100:00100000:2.0:1788568742.802539:0:12276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27f83c0c-e36b-48ce-9485-80051fd252dc+56:11509:x1875449958444160:12345-192.168.206.4@tcp:58:lfs.0 00010000:00010000:2.0:1788568742.802775:0:12276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a18e6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.802797:0:12276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a18e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568742.802812:0:12276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a18e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788568742.803499:0:12276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1788568742.804290:0:12276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27f83c0c-e36b-48ce-9485-80051fd252dc+56:11509:x1875449958444160:12345-192.168.206.4@tcp:58:lfs.0 Request processed in 1755us (2498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568742.804320:0:12276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 169 00000100:00100000:1.0:1788568742.831549:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568742.831700:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958444288 00000100:00100000:3.0:1788568742.831722:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958444288 00000100:00100000:3.0:1788568742.831800:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 170 00000100:00100000:3.0:1788568742.831813:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+56:11511:x1875449958444288:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:3.0:1788568742.831841:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568742.831868:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a18ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bed5d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.832004:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a18f4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.832021:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a18f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.832043:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a18f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.832062:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a18fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.832069:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a18fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.832076:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a18fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.832203:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1902 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.832234:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1902 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.832241:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1902 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788568742.832284:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788568742.832289:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788568742.832308:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1902 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.832321:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1902 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.832330:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a18f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.832336:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a18f4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.832343:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a18f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.832349:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429dea00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568742.832353:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a18f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.832362:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a18f4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.832375:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ae2430ad300) 00010000:00010000:3.0:1788568742.832379:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788568742.832391:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a18f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.832399:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a18f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.832417:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a18fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.832423:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a18fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.832429:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a18fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.832434:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429de600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568742.832437:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a18fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.832443:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a18fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.832450:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ae2430ad600) 00010000:00010000:3.0:1788568742.832452:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788568742.832455:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a18fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.832460:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a18fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.832494:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a18ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed5d expref: 58 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.832522:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1902 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed5d expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568742.832530:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae255fb9b00) 00010000:00010000:3.0:1788568742.832532:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788568742.832534:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429de800, rc 0) 00000100:00100000:3.0:1788568742.832850:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+57:11511:x1875449958444288:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 1038us (1320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568742.832859:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 170 00010000:00010000:3.0:1788568743.096170:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568743.424462:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976269312:0@lo:400:kworker.0 00000100:00100000:0.0:1788568743.424527:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568743.424568:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875449976269824:0@lo:400:kworker.0 00000100:00100000:0.0:1788568743.424590:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568743.424612:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788568743.424617:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976269440:0@lo:400:kworker.0 00000100:00100000:0.0:1788568743.424635:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568743.424651:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976269952:0@lo:400:kworker.0 00000100:00100000:0.0:1788568743.424674:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568743.424715:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976269568:0@lo:400:kworker.0 00000100:00100000:0.0:1788568743.424737:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568743.424756:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788568743.424761:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976269696:0@lo:400:kworker.0 00000100:00100000:0.0:1788568743.424783:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568743.424812:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976269312 00000100:00100000:0.0:1788568743.424832:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976269312 00000100:00100000:0.0:1788568743.424873:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1788568743.424881:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25044a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+19:3306:x1875449976269312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568743.424957:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25044a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+19:3306:x1875449976269312:12345-0@lo:400:kworker.0 Request processed in 45us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568743.424965:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1788568743.424999:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976269824 00000100:00100000:0.0:1788568743.425003:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976269824 00000100:00100000:0.0:1788568743.425034:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976269440 00000100:00100000:0.0:1788568743.425037:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976269440 00000100:00100000:0.0:1788568743.425051:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976269568 00000100:00100000:0.0:1788568743.425053:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976269568 00000100:00100000:0.0:1788568743.425066:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788568743.425071:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875449976269824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568743.425103:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875449976269824:12345-0@lo:400:kworker.0 Request processed in 31us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568743.425123:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788568743.425135:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788568743.425141:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976269440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568743.425166:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976269440:12345-0@lo:400:kworker.0 Request processed in 26us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568743.425171:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788568743.425182:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788568743.425188:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976269568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568743.425217:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976269568:12345-0@lo:400:kworker.0 Request processed in 29us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568743.425222:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788568743.425249:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976269952 00000100:00100000:0.0:1788568743.425253:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976269952 00000100:00100000:0.0:1788568743.425275:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976269696 00000100:00100000:0.0:1788568743.425278:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976269696 00000100:00100000:0.0:1788568743.425297:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788568743.425303:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875449976269952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568743.425331:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875449976269952:12345-0@lo:400:kworker.0 Request processed in 28us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568743.425338:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788568743.425349:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788568743.425355:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976269696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568743.425380:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976269696:12345-0@lo:400:kworker.0 Request processed in 26us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568743.425386:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788568743.425430:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976269440:0@lo:400:kworker.0 00000100:00100000:0.0:1788568743.425442:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976269952:0@lo:400:kworker.0 00000100:00100000:0.0:1788568743.425450:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976269312:0@lo:400:kworker.0 00000100:00100000:0.0:1788568743.425458:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875449976269824:0@lo:400:kworker.0 00000100:00080000:0.0:1788568743.425480:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788568743.425484:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788568743.425486:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788568743.425507:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976269696:0@lo:400:kworker.0 00000100:00100000:0.0:1788568743.425516:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976269568:0@lo:400:kworker.0 00000001:00080000:1.0:1788568743.495780:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967453 is committed 00000001:00080000:1.0:1788568743.495810:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967454 is committed 00000001:00080000:1.0:1788568743.495837:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000004:00080000:1.0:1788568743.495851:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788568743.495867:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ae2526e19c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1788568743.495872:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ae250422900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ae2526e1d80 00000020:00080000:1.0:1788568743.495875:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ae250422100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ae26f79c000 00000020:00080000:1.0:1788568743.496030:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1788568743.496209:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1788568743.496229:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976270080:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788568743.496290:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568743.496352:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976270080 00000100:00100000:1.0:1788568743.496360:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976270080 00000100:00100000:1.0:1788568743.496400:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788568743.496409:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1875449976270080:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788568743.496445:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:1.0:1788568743.496475:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9b64a3, atime: 0x6a9b64a3, ctime: 0x6a9b64a3, blocks: 0xb 00010000:00010000:1.0:1788568743.496483:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b138b48f/0x41e82f464b6a1909 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568743.496498:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=377s v=(0 0) 00010000:00010000:1.0:1788568743.496503:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788568743.496509:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b138b48f/0x41e82f464b6a1909 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568743.496524:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b138b48f/0x41e82f464b6a1909 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568743.496540:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b138b48f/0x41e82f464b6a1909 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568743.496548:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b138b48f/0x41e82f464b6a1909 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568743.496565:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788568743.499674:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3308:x1875449976270080:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3260us (3376us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788568743.499685:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:1.0:1788568743.499737:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788568743.499745:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b138b48f/0x41e82f464b6a1909 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568743.499771:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2c600 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:1.0:1788568743.499775:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b138b48f/0x41e82f464b6a1909 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568743.499786:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b138b48f/0x41e82f464b6a1909 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568743.499805:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b138b48f/0x41e82f464b6a1909 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568743.499813:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b138b48f/0x41e82f464b6a1909 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568743.499835:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568743.499837:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568743.499839:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788568743.500129:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ae141c32a00/2, rc 0, transno 4294967307 00000100:00100000:3.0:1788568743.500137:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976270080:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1788568743.542086:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:2.0:1788568743.542099:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000040:00080000:0.0:1788568743.674321:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788568743.674330:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788568743.674398:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788568743.674408:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788568743.674522:0:11686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae281708700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11686:1875449976270208:192.168.206.4@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788568743.674614:0:11686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae244836180 going to sleep for 11 seconds 00000100:00100000:1.0:1788568743.691403:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568743.691437:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958444416 00000100:00100000:1.0:1788568743.691446:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958444416 00000100:00100000:1.0:1788568743.691498:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 171 00000100:00100000:1.0:1788568743.691508:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+17:11522:x1875449958444416:12345-192.168.206.4@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788568743.691537:0:5842:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788568743.691630:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+17:11522:x1875449958444416:12345-192.168.206.4@tcp:53:lhsmtool_posix.0 Request processed in 122us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568743.691637:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 171 00000100:00100000:3.0:1788568743.695515:0:11686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae281708700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11686:1875449976270208:192.168.206.4@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788568743.695837:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568743.695868:0:12276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958444544 00000100:00100000:3.0:1788568743.695875:0:12276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958444544 00000100:00100000:3.0:1788568743.695941:0:12276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 172 00000100:00100000:3.0:1788568743.695952:0:12276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27f83c0c-e36b-48ce-9485-80051fd252dc+16:11522:x1875449958444544:12345-192.168.206.4@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788568743.696018:0:12276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1910 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568743.696036:0:12276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1910 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568743.696050:0:12276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1910 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568743.696141:0:12276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1917 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568743.696151:0:12276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1917 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568743.696158:0:12276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1917 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568743.696185:0:12276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a191e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568743.696194:0:12276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a191e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568743.696200:0:12276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a191e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788568743.696235:0:12276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788568743.696239:0:12276:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788568743.696252:0:12276:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a191e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568743.696263:0:12276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1910 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568743.696270:0:12276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1910 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568743.696276:0:12276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1910 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568743.696293:0:12276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429df200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568743.696297:0:12276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1910 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568743.696305:0:12276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1910 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568743.696316:0:12276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ae25820cd00) 00010000:00010000:3.0:1788568743.696319:0:12276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788568743.696323:0:12276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1910 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568743.696329:0:12276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1910 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568743.696341:0:12276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1917 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568743.696347:0:12276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1917 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568743.696353:0:12276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1917 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568743.696357:0:12276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429de600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568743.696360:0:12276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1917 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568743.696365:0:12276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1917 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568743.696381:0:12276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9ae2430ad500) 00010000:00010000:3.0:1788568743.696384:0:12276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788568743.696387:0:12276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1917 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568743.696393:0:12276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1917 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568743.696408:0:12276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a191e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568743.696414:0:12276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a191e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568743.696419:0:12276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a191e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568743.696424:0:12276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429dea00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568743.696427:0:12276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a191e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568743.696432:0:12276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a191e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568743.696439:0:12276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae255fb9b00) 00010000:00010000:3.0:1788568743.696441:0:12276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788568743.696444:0:12276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a191e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568743.696449:0:12276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a191e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568743.696524:0:12276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27f83c0c-e36b-48ce-9485-80051fd252dc+16:11522:x1875449958444544:12345-192.168.206.4@tcp:34:lhsmtool_posix.0 Request processed in 573us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568743.696531:0:12276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 172 00000100:00100000:1.0:1788568743.700623:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568743.700795:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958444800 00000100:00100000:2.0:1788568743.700805:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958444800 00000100:00100000:2.0:1788568743.700870:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 173 00000100:00100000:2.0:1788568743.700880:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+16:11522:x1875449958444800:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788568743.700899:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568743.700919:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1925 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bed64 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568743.701034:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a192c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568743.701049:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a192c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568743.701335:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a192c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788568743.701347:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788568743.701539:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a192c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568743.701548:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a192c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568743.701555:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a192c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568743.701574:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7aa00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568743.701579:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a192c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568743.701587:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a192c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568743.701603:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae255fb9b00) 00010000:00010000:2.0:1788568743.701606:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788568743.701613:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a192c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568743.701620:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a192c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568743.701673:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1925 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed64 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568743.701684:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ae25820cd00) 00010000:00010000:2.0:1788568743.701687:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788568743.701691:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1925 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed64 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568743.701702:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7be00, rc 0) 00000100:00100000:2.0:1788568743.701815:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+17:11522:x1875449958444800:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 934us (1199us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1788568743.701824:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 173 00000100:00100000:1.0:1788568743.709966:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568743.710272:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958444928 00000100:00100000:0.0:1788568743.710282:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958444928 00000100:00100000:0.0:1788568743.710512:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 174 00000100:00100000:0.0:1788568743.710525:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+17:11522:x1875449958444928:12345-192.168.206.4@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788568743.710561:0:6714:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788568743.710712:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+17:11522:x1875449958444928:12345-192.168.206.4@tcp:53:lhsmtool_posix.0 Request processed in 189us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568743.710720:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 174 00000100:00100000:1.0:1788568743.717625:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568743.717730:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958445184 00000100:00100000:0.0:1788568743.717741:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958445184 00000100:00100000:0.0:1788568743.717802:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 175 00000100:00100000:0.0:1788568743.717814:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+17:11522:x1875449958445184:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788568743.717845:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568743.717849:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788568743.717874:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a18df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed56 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568743.717891:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ae2430ad300) 00010000:00010000:0.0:1788568743.717896:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788568743.717909:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a193a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bed6b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788568743.718698:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1788568743.719024:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1941 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568743.719039:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1941 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568743.719050:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1941 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568743.719117:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a193a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed6b expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568743.719134:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1941 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed6b expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568743.719142:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ae24515aa00) 00010000:00010000:0.0:1788568743.719145:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788568743.719148:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae27feab000, rc 0) 00000100:00100000:0.0:1788568743.719220:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+18:11522:x1875449958445184:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 1408us (1602us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1788568743.719228:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 175 00000100:00100000:1.0:1788568743.728307:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568743.728412:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958445440 00000100:00100000:2.0:1788568743.728429:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958445440 00000100:00100000:2.0:1788568743.731532:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 176 00000100:00100000:2.0:1788568743.731554:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+18:11522:x1875449958445440:12345-192.168.206.4@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788568743.731613:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568743.731643:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab000/0x41e82f464b6a1941 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed6b expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568743.731659:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ae24515aa00) 00010000:00010000:2.0:1788568743.731670:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788568743.731691:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a194f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568743.731704:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a194f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568743.731714:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a194f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568743.731777:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1956 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x374757db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568743.731786:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1956 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x374757db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568743.731792:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1956 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x374757db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568743.732155:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a194f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568743.732164:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a194f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568743.732179:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a194f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568743.732186:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7be00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568743.732191:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a194f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568743.732199:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a194f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568743.732208:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ae2430ad300) 00010000:00010000:2.0:1788568743.732212:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788568743.732217:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a194f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568743.732224:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a194f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568743.732248:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1956 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x374757db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568743.732254:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1956 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x374757db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568743.732260:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1956 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x374757db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568743.732265:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7aa00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568743.732268:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1956 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x374757db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568743.732285:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1956 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x374757db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568743.732294:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x374757db (ffff9ae255fb9c00) 00010000:00010000:2.0:1788568743.732297:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788568743.732300:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1956 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x374757db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568743.732306:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1956 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x374757db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568743.732407:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+17:11522:x1875449958445440:12345-192.168.206.4@tcp:36:lhsmtool_posix.0 Request processed in 861us (4108us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788568743.732415:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 176 00000100:00100000:1.0:1788568743.738134:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568743.738710:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958445568 00000100:00100000:2.0:1788568743.738720:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958445568 00000100:00100000:2.0:1788568743.738777:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 177 00000100:00100000:2.0:1788568743.738787:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+17:11522:x1875449958445568:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788568743.738804:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568743.738824:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a195d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bed72 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568743.738874:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1964 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568743.738888:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568743.738899:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568743.739012:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a195d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed72 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568743.739037:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1964 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed72 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568743.739045:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ae255fb9d00) 00010000:00010000:2.0:1788568743.739048:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788568743.739052:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7ae00, rc 0) 00000100:00100000:2.0:1788568743.739124:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+18:11522:x1875449958445568:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 338us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568743.739131:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 177 00000100:00100000:1.0:1788568743.744438:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568743.745410:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958445824 00000100:00100000:2.0:1788568743.745422:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958445824 00000100:00100000:2.0:1788568743.745518:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 178 00000100:00100000:2.0:1788568743.745531:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+18:11522:x1875449958445824:12345-192.168.206.4@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788568743.745614:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a196b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568743.745630:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a196b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568743.745641:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a196b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788568743.745984:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:2.0:1788568743.745997:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 378154069401ns, next at 379154065862ns, rc = 0 00000004:00010000:2.0:1788568743.746103:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006c6e6300 reply state 00000000c8efa800 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a196b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568743.746123:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788568743.746214:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+20:11522:x1875449958445824:12345-192.168.206.4@tcp:36:lhsmtool_posix.0 Request processed in 686us (1786us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1788568743.746221:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 178 00010000:00010000:1.0:1788568743.753066:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a196b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568743.753082:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a196b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568743.753090:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a196b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568743.753096:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7b200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568743.753101:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a196b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568743.753119:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a196b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568743.753138:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ae255fb9d00) 00010000:00010000:1.0:1788568743.753142:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788568743.753149:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a196b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568743.753156:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a196b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568743.761009:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568743.761538:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958445952 00000100:00100000:1.0:1788568743.761554:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958445952 00000100:00100000:1.0:1788568743.761601:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 179 00000100:00100000:1.0:1788568743.761611:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+19:11522:x1875449958445952:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788568743.761631:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568743.761649:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1972 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bed79 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568743.761702:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1972 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed79 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568743.761716:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1972 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed79 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568743.761732:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ae255fb9d00) 00010000:00010000:1.0:1788568743.761735:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788568743.761739:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2d800, rc 0) 00000100:00100000:1.0:1788568743.761790:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+20:11522:x1875449958445952:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 181us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568743.761797:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 179 00000100:00100000:0.0:1788568743.767244:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568743.767283:0:8111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958446080 00000100:00100000:0.0:1788568743.767293:0:8111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958446080 00000100:00100000:0.0:1788568743.767349:0:8111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 51 00000100:00100000:0.0:1788568743.767360:0:8111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281709c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2363:x1875449958446080:12345-192.168.206.4@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788568743.769676:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788568743.769798:0:8111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281709c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+7:2363:x1875449958446080:12345-192.168.206.4@tcp:2:lhsmtool_posix.0 Request processed in 2433us (2554us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788568743.769819:0:8111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 51 00000100:00100000:0.0:1788568743.772529:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568743.772565:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958446336 00000100:00100000:0.0:1788568743.772574:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958446336 00000100:00100000:0.0:1788568743.772632:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 49 00000100:00100000:0.0:1788568743.772643:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae28170a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+20:11522:x1875449958446336:12345-192.168.206.4@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788568743.772861:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae28170a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+21:11522:x1875449958446336:12345-192.168.206.4@tcp:35:lhsmtool_posix.0 Request processed in 220us (340us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1788568743.772869:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 49 00000100:00100000:3.0:1788568743.775096:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568743.775249:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958446592 00000100:00100000:0.0:1788568743.775261:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958446592 00000100:00100000:0.0:1788568743.775321:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 180 00000100:00100000:0.0:1788568743.775331:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+21:11522:x1875449958446592:12345-192.168.206.4@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788568743.775431:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+21:11522:x1875449958446592:12345-192.168.206.4@tcp:57:lhsmtool_posix.0 Request processed in 101us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568743.775439:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 180 00000040:00080000:2.0:1788568743.781215:0:12468:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788568743.781224:0:12468:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788568743.781260:0:12468:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788568743.781266:0:12468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788568743.803900:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568743.803980:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958446720 00000100:00100000:1.0:1788568743.803991:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958446720 00000100:00100000:1.0:1788568743.804066:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 181 00000100:00100000:1.0:1788568743.804076:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+21:11522:x1875449958446720:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788568743.804095:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568743.804124:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1979 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bed80 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568743.804218:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a1980 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568743.804232:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a1980 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568743.804244:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a1980 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568743.804276:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788568743.804293:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a1980 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568743.804319:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1979 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed80 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568743.804333:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a1980 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed80 expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568743.804341:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ae255fb9d00) 00010000:00010000:1.0:1788568743.804344:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788568743.804347:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2d000, rc 0) 00000100:00100000:1.0:1788568743.804398:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+22:11522:x1875449958446720:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 323us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568743.804405:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 181 00000100:00100000:2.0:1788568743.812364:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568743.812496:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958446848 00000100:00100000:1.0:1788568743.812506:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958446848 00000100:00100000:1.0:1788568743.812571:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 52 00000100:00100000:1.0:1788568743.812599:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+7:2364:x1875449958446848:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788568743.812618:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568743.812640:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008675e575/0x41e82f464b6a1987 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bed87 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788568743.812667:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b64a6, blocks: 0x1 00010000:00010000:1.0:1788568743.812688:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=378s v=(0 0) 00010000:00010000:1.0:1788568743.812693:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788568743.812704:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008675e575/0x41e82f464b6a1987 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed87 expref: 8 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568743.812723:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008675e575/0x41e82f464b6a1987 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed87 expref: 8 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568743.812736:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2d200, rc 0) 00000100:00100000:1.0:1788568743.812795:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+8:2364:x1875449958446848:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 199us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568743.812802:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 52 00000100:00100000:0.0:1788568743.838566:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568743.838639:0:12276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958447104 00000100:00100000:3.0:1788568743.838649:0:12276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958447104 00000100:00100000:3.0:1788568743.838711:0:12276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 182 00000100:00100000:3.0:1788568743.838722:0:12276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27f83c0c-e36b-48ce-9485-80051fd252dc+22:11522:x1875449958447104:12345-192.168.206.4@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788568743.838842:0:12276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27f83c0c-e36b-48ce-9485-80051fd252dc+22:11522:x1875449958447104:12345-192.168.206.4@tcp:57:lhsmtool_posix.0 Request processed in 108us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568743.838850:0:12276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 182 00000100:00100000:2.0:1788568743.854032:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568743.855300:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958447232 00000100:00100000:1.0:1788568743.855312:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958447232 00000100:00100000:1.0:1788568743.855378:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 53 00000100:00100000:1.0:1788568743.855389:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+8:11522:x1875449958447232:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788568743.855408:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568743.855426:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ced32e2/0x41e82f464b6a198e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bed8e expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568743.855477:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008675e575/0x41e82f464b6a1987 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed87 expref: 9 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568743.855487:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788568743.855491:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788568743.855496:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ced32e2/0x41e82f464b6a198e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed8e expref: 9 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568743.855529:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008675e575/0x41e82f464b6a1987 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed87 expref: 9 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568743.855542:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008675e575/0x41e82f464b6a1987 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed87 expref: 9 pid: 6691 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568743.855556:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae281b03800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6688:1875449976270336:192.168.206.4@tcp:104: 00000100:00100000:1.0:1788568743.855648:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2503d5600 going to sleep for 11 seconds 00000100:00100000:2.0:1788568743.858996:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568743.859209:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958447360 00000100:00100000:3.0:1788568743.859219:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958447360 00010000:00010000:3.0:1788568743.859255:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008675e575/0x41e82f464b6a1987 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed87 expref: 10 pid: 6691 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568743.859301:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 68 00000100:00100000:3.0:1788568743.859311:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bcbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+10:2364:x1875449958447360:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788568743.859325:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568743.859345:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008675e575/0x41e82f464b6a1987 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed87 expref: 10 pid: 6691 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568743.859358:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008675e575/0x41e82f464b6a1987 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed87 expref: 10 pid: 6691 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568743.859401:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788568743.859406:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788568743.859415:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009ced32e2/0x41e82f464b6a198e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed8e expref: 10 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568743.859426:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ced32e2/0x41e82f464b6a198e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed8e expref: 10 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568743.859464:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009ced32e2/0x41e82f464b6a198e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed8e expref: 10 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568743.859477:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf06a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5829:1875449976270464:192.168.206.4@tcp:105: 00000100:00100000:3.0:1788568743.859534:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae250ac8780 going to sleep for 11 seconds 00010000:00010000:1.0:1788568743.860541:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008675e575/0x41e82f464b6a1987 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed87 expref: 10 pid: 6691 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568743.860558:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae281b03800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6688:1875449976270336:192.168.206.4@tcp:104: 00010000:00010000:1.0:1788568743.860596:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009ced32e2/0x41e82f464b6a198e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed8e expref: 9 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568743.860608:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2d400, rc 0) 00000100:00100000:1.0:1788568743.860678:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+9:11522:x1875449958447232:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 5291us (6655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568743.860686:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 53 00000100:00100000:3.0:1788568743.866546:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf06a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5829:1875449976270464:192.168.206.4@tcp:105: 00010000:00010000:3.0:1788568743.866572:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788568743.866630:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bcbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+8:2364:x1875449958447360:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 7320us (7641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568743.866642:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 68 00000100:00100000:3.0:1788568743.870778:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568743.870883:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958447488 00000100:00100000:2.0:1788568743.870893:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958447488 00002000:00100000:2.0:1788568743.870973:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9ae27bf06a00 x1875449958447488/t0(0) o4->27f83c0c-e36b-48ce-9485-80051fd252dc@192.168.206.4@tcp:179/0 lens 504/0 e 0 to 0 dl 1788568754 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788568743.870985:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae27bf06a00 with x1875449958447488 ext(0->8) 00002000:00010000:2.0:1788568743.870990:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ae27bf06a00 00000100:00100000:2.0:1788568743.871017:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 4 00000100:00100000:2.0:1788568743.871027:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+8:2362:x1875449958447488:12345-192.168.206.4@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788568743.871548:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+10:2362:x1875449958447488:12345-192.168.206.4@tcp:4:lhsmtool_posix.0 Request processed in 520us (776us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788568743.871557:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 4 00002000:00100000:2.0:1788568743.871570:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9ae27bf06a00 x1875449958447488/t4294967314(0) o4->27f83c0c-e36b-48ce-9485-80051fd252dc@192.168.206.4@tcp:179/0 lens 504/448 e 0 to 0 dl 1788568754 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788568743.871579:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae27bf06a00 with x1875449958447488 ext(0->8) 00002000:00010000:2.0:1788568743.871582:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ae27bf06a00 00000100:00100000:3.0:1788568743.874809:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568743.874903:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958447616 00000100:00100000:2.0:1788568743.874911:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958447616 00000100:00100000:2.0:1788568743.874981:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 183 00000100:00100000:2.0:1788568743.874990:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+22:11522:x1875449958447616:12345-192.168.206.4@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1788568743.912269:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+22:11522:x1875449958447616:12345-192.168.206.4@tcp:44:lhsmtool_posix.0 Request processed in 37269us (37457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568743.912282:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 183 00000001:00080000:1.0:1788568743.912319:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:1.0:1788568743.912334:0:5865:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:1.0:1788568743.912349:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:1.0:1788568743.912374:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1788568743.912384:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1788568743.912492:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae281b03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976270592:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788568743.912541:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568743.912595:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976270592 00000100:00100000:1.0:1788568743.912601:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976270592 00000100:00100000:1.0:1788568743.912635:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788568743.912643:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281b03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976270592:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788568743.912780:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788568743.912783:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788568742 00002000:00010000:1.0:1788568743.912785:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788568743.912787:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788568742 -> 1788568742 00002000:00010000:1.0:1788568743.912789:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788568743.912821:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281b03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1875449976270592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 179us (280us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788568743.912828:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:1.0:1788568743.915308:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ae281b03800/2, rc 0, transno 4294967315 00000100:00100000:1.0:1788568743.915325:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae281b03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976270592:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788568743.922238:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568743.922640:0:8111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958447744 00000100:00100000:0.0:1788568743.922652:0:8111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958447744 00000100:00100000:0.0:1788568743.922710:0:8111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 55 00000100:00100000:0.0:1788568743.922721:0:8111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bcbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+10:2363:x1875449958447744:12345-192.168.206.4@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788568743.928657:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976270720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788568743.928721:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568743.930235:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976270720 00000100:00100000:0.0:1788568743.930248:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976270720 00000100:00100000:0.0:1788568743.930303:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788568743.930321:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bcbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875449976270720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788568743.930366:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788568743.932227:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bcbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875449976270720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1907us (3497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568743.932240:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788568743.935319:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:2.0:1788568743.935331:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:2.0:1788568743.935357:0:3306:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9ae141c32a00 x1875449976270080/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788568759 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568743.935382:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976270720:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1788568744.023040:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:3.0:1788568744.023057:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:3.0:1788568744.023066:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:1.0:1788568744.024073:0:8111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bcbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+7:2363:x1875449958447744:12345-192.168.206.4@tcp:16:lhsmtool_posix.0 Request processed in 101344us (101835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568744.024085:0:8111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 55 00000100:00100000:0.0:1788568744.029222:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568744.029629:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958448000 00000100:00100000:2.0:1788568744.029640:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958448000 00000100:00100000:2.0:1788568744.029720:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 184 00000100:00100000:2.0:1788568744.029731:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+18:11522:x1875449958448000:12345-192.168.206.4@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788568744.029783:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568744.029809:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a1980 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed80 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568744.029840:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ae255fb9d00) 00010000:00010000:2.0:1788568744.029861:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788568744.029891:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1995 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568744.029905:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1995 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568744.029916:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1995 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788568744.030209:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c87f9b0 reply state 00000000bd7249a9 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1995 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568744.030218:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00080000:3.0:1788568744.030434:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788568744.032731:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+19:11522:x1875449958448000:12345-192.168.206.4@tcp:36:lhsmtool_posix.0 Request processed in 2992us (3508us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1788568744.032743:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 184 00010000:00010000:3.0:1788568744.035779:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1995 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.035810:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1995 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.035818:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1995 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.035824:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7b600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568744.035842:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1995 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.035850:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1995 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.035869:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ae255fb9d00) 00010000:00010000:3.0:1788568744.035872:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788568744.035877:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1995 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.035883:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1995 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568744.038689:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568744.038776:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958448128 00000100:00100000:1.0:1788568744.038786:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958448128 00000100:00100000:1.0:1788568744.038845:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 56 00000100:00100000:1.0:1788568744.038856:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+7:2363:x1875449958448128:12345-192.168.206.4@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788568744.039159:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788568744.039163:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788568742 -> 1788568741 00002000:00010000:1.0:1788568744.039166:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788568739 00002000:00010000:1.0:1788568744.039167:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788568742 -> 1788568741 00002000:00010000:1.0:1788568744.039169:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788568744.039223:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+8:2363:x1875449958448128:12345-192.168.206.4@tcp:2:lhsmtool_posix.0 Request processed in 369us (542us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788568744.039230:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 56 00000100:00100000:0.0:1788568744.043249:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568744.043330:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958448384 00000100:00100000:1.0:1788568744.043340:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958448384 00000100:00100000:1.0:1788568744.043401:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 185 00000100:00100000:1.0:1788568744.043412:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+18:11522:x1875449958448384:12345-192.168.206.4@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788568744.043475:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a199c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568744.043491:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1964 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed72 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568744.043501:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a199c lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568744.043549:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1964 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed72 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568744.043564:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1964 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed72 expref: 18 pid: 5843 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568744.043578:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2526d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1875449976270848:192.168.206.4@tcp:104: 00000100:00100000:1.0:1788568744.043665:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2503d5e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788568744.047404:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568744.047525:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2526d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1875449976270848:192.168.206.4@tcp:104: 00010000:00010000:1.0:1788568744.047564:0:6714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a199c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568744.047676:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958448512 00000100:00100000:2.0:1788568744.047684:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958448512 00010000:00010000:2.0:1788568744.047721:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1964 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed72 expref: 19 pid: 5843 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568744.047804:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 69 00000100:00100000:2.0:1788568744.047814:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25319c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+19:2363:x1875449958448512:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788568744.047828:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568744.047846:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1964 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed72 expref: 19 pid: 5843 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568744.047858:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1964 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed72 expref: 19 pid: 5843 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568744.047898:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1964 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed72 expref: 19 pid: 5843 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568744.047959:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ae255fb9d00) 00010000:00010000:2.0:1788568744.047964:0:6705:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a199c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568744.047974:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a199c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568744.047983:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a199c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568744.048004:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788568744.048518:0:6714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a199c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568744.048527:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a199c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568744.048560:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a199c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568744.048566:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a199c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568744.048573:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a199c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568744.048578:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2d200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568744.048582:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a199c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568744.048597:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a199c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568744.048608:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ae255fb9d00) 00010000:00010000:1.0:1788568744.048610:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788568744.048615:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a199c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568744.048620:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a199c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568744.048678:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+18:11522:x1875449958448384:12345-192.168.206.4@tcp:55:lhsmtool_posix.0 Request processed in 5267us (5439us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788568744.048687:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 185 00000100:00100000:2.0:1788568744.048778:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25319c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+17:2363:x1875449958448512:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 964us (1382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568744.048786:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 69 00000100:00100000:3.0:1788568744.052878:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568744.052992:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958448640 00000100:00100000:1.0:1788568744.053002:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958448640 00000100:00100000:1.0:1788568744.053049:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 57 00000100:00100000:1.0:1788568744.053069:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+8:2364:x1875449958448640:12345-192.168.206.4@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788568744.053122:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000617d8a05/0x41e82f464b6a19a3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568744.053150:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009ced32e2/0x41e82f464b6a198e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed8e expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568744.053158:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788568744.053162:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788568744.053166:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000617d8a05/0x41e82f464b6a19a3 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568744.053213:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009ced32e2/0x41e82f464b6a198e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed8e expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568744.053226:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009ced32e2/0x41e82f464b6a198e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed8e expref: 8 pid: 6688 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568744.053240:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2526d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6688:1875449976270976:192.168.206.4@tcp:104: 00000100:00100000:1.0:1788568744.053311:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2503d5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788568744.058402:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568744.059212:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2526d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6688:1875449976270976:192.168.206.4@tcp:104: 00010000:00010000:1.0:1788568744.059249:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000617d8a05/0x41e82f464b6a19a3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568744.059317:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958448768 00000100:00100000:2.0:1788568744.059325:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958448768 00010000:00010000:2.0:1788568744.059361:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009ced32e2/0x41e82f464b6a198e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed8e expref: 9 pid: 6688 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568744.059437:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 70 00000100:00100000:2.0:1788568744.059446:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+9:2364:x1875449958448768:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788568744.059461:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568744.059484:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009ced32e2/0x41e82f464b6a198e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed8e expref: 9 pid: 6688 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568744.059514:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009ced32e2/0x41e82f464b6a198e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed8e expref: 9 pid: 6688 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568744.059537:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ced32e2/0x41e82f464b6a198e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed8e expref: 9 pid: 6688 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568744.059552:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788568744.059557:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788568744.059562:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000617d8a05/0x41e82f464b6a19a3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568744.059572:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000617d8a05/0x41e82f464b6a19a3 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568744.059601:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568744.059659:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+8:2364:x1875449958448768:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 213us (1265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568744.059666:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 70 00010000:00010000:1.0:1788568744.059712:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000617d8a05/0x41e82f464b6a19a3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568744.059720:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000617d8a05/0x41e82f464b6a19a3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568744.059743:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000617d8a05/0x41e82f464b6a19a3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568744.059752:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000617d8a05/0x41e82f464b6a19a3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568744.059772:0:6688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000617d8a05/0x41e82f464b6a19a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568744.059779:0:6688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2d000 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:1.0:1788568744.059783:0:6688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000617d8a05/0x41e82f464b6a19a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568744.059792:0:6688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000617d8a05/0x41e82f464b6a19a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568744.059803:0:6688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000617d8a05/0x41e82f464b6a19a3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568744.059812:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000617d8a05/0x41e82f464b6a19a3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568744.059866:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+7:2364:x1875449958448640:12345-192.168.206.4@tcp:1:lhsmtool_posix.0 Request processed in 6799us (6997us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568744.059873:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 57 00000100:00100000:1.0:1788568744.062646:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568744.062728:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958449024 00000100:00100000:2.0:1788568744.062738:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958449024 00000100:00100000:2.0:1788568744.062818:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 186 00000100:00100000:2.0:1788568744.062838:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+17:11522:x1875449958449024:12345-192.168.206.4@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788568744.062915:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a19aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568744.063218:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a19aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568744.063244:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a19aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568744.063459:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a19b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568744.063471:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1972 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed79 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568744.063480:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a19b1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568744.063512:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1972 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed79 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568744.063527:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1972 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed79 expref: 18 pid: 5843 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568744.063540:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bcbdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875449976271104:192.168.206.4@tcp:104: 00000100:00100000:2.0:1788568744.063655:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae248a96e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788568744.069585:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568744.069730:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bcbdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875449976271104:192.168.206.4@tcp:104: 00010000:00010000:2.0:1788568744.069763:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a19b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568744.070038:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958449152 00000100:00100000:3.0:1788568744.070045:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958449152 00010000:00010000:3.0:1788568744.070087:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1972 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed79 expref: 19 pid: 5843 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568744.070141:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 71 00000100:00100000:3.0:1788568744.070165:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+19:2364:x1875449958449152:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788568744.070179:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568744.070187:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1972 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed79 expref: 19 pid: 5843 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.070199:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1972 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed79 expref: 19 pid: 5843 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.070221:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1972 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed79 expref: 19 pid: 5843 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.070237:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ae255fb9d00) 00010000:00010000:3.0:1788568744.070242:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a19b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.070253:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a19b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.070261:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a19b1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.070283:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788568744.071261:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+18:2364:x1875449958449152:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 1090us (1678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568744.071271:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 71 00010000:00010000:3.0:1788568744.071302:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a19b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.071309:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a19b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788568744.071484:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1788568744.071637:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1788568744.071685:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1788568744.071768:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf04380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1875449976271232:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788568744.071822:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568744.071870:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243d4e180 going to sleep for 11 seconds 00000100:00100000:0.0:1788568744.073497:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976271232 00000100:00100000:0.0:1788568744.073511:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976271232 00000100:00100000:0.0:1788568744.073613:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788568744.073625:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1875449976271232:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788568744.073757:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1875449976271232:12345-0@lo:1000:mdt00_000.0 Request processed in 133us (1933us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568744.073765:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788568744.073847:0:5842:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1788568744.073853:0:5842:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ae281b03800, transno 4294967315 00000100:00100000:3.0:1788568744.073879:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf04380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1875449976271232:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1788568744.074441:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1788568744.074523:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf04380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1875449976271360:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788568744.074569:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568744.075757:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2487d33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788568744.075795:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976271360 00000100:00100000:1.0:1788568744.075802:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976271360 00000100:00100000:1.0:1788568744.075853:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788568744.075862:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1875449976271360:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788568744.076437:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5842:x1875449976271360:12345-0@lo:1000:mdt00_000.0 Request processed in 574us (1865us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788568744.076446:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788568744.076523:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf04380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1875449976271360:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1788568744.076564:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a19b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.076573:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a19b1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.076581:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a19b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.076587:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7be00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568744.076591:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a19b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.076599:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a19b1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.076623:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ae255fb9d00) 00010000:00010000:3.0:1788568744.076626:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788568744.076630:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a19b1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.076637:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a19b1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.076677:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a18e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.076682:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a18e6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.076688:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a18e6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.076693:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7a600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568744.076696:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a18e6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.076702:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a18e6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.076709:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae255fb9b00) 00010000:00010000:3.0:1788568744.076712:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788568744.076714:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a18e6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.076720:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a18e6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.076754:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a19b8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.076766:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1902 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed5d expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.076774:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a19b8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.076804:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1902 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed5d expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.076817:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1902 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed5d expref: 21 pid: 5844 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568744.076903:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf06680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875449976271488:192.168.206.4@tcp:104: 00000100:00100000:1.0:1788568744.077317:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2487d33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788568744.081645:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568744.081731:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf06680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875449976271488:192.168.206.4@tcp:104: 00010000:00010000:1.0:1788568744.081759:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a19b8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568744.082124:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958449280 00000100:00100000:3.0:1788568744.082142:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958449280 00010000:00010000:3.0:1788568744.082180:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1902 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed5d expref: 22 pid: 5844 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568744.082226:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 72 00000100:00100000:3.0:1788568744.082235:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+22:2363:x1875449958449280:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788568744.082248:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568744.082254:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1902 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed5d expref: 22 pid: 5844 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.082284:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1902 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed5d expref: 22 pid: 5844 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.082305:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1902 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed5d expref: 22 pid: 5844 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.082320:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae255fb9b00) 00010000:00010000:3.0:1788568744.082325:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a19b8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.082334:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a19b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.082342:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a19b8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.082365:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788568744.083070:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+21:2363:x1875449958449280:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 832us (1429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568744.083078:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 72 00010000:00010000:3.0:1788568744.083114:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a19b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.083122:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a19b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.083372:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a19b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.083395:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a19b8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.083401:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a19b8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.083407:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429de600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568744.083412:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a19b8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.083421:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a19b8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.083434:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae255fb9b00) 00010000:00010000:3.0:1788568744.083437:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788568744.083441:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a19b8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.083449:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a19b8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.083464:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a19aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.083470:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a19aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.083476:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a19aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.083482:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7aa00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568744.083492:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a19aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.083499:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a19aa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.083506:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae255fb9b00) 00010000:00010000:3.0:1788568744.083508:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788568744.083511:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a19aa lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568744.083516:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a19aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788568744.084067:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788568744.084072:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788568744.084555:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1788568744.084564:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788568744.085969:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+20:11522:x1875449958449024:12345-192.168.206.4@tcp:57:lhsmtool_posix.0 Request processed in 23133us (23322us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1788568744.085982:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 186 00000020:00080000:3.0:1788568744.085988:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1788568744.088677:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568744.088767:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958449536 00000100:00100000:0.0:1788568744.088777:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958449536 00000100:00100000:0.0:1788568744.088951:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 50 00000100:00100000:0.0:1788568744.088966:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24926c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+20:11522:x1875449958449536:12345-192.168.206.4@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788568744.090007:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788568744.090335:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1788568744.090387:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a19bf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568744.090403:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a19bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568744.090415:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a19bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568744.090432:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a19bf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568744.090438:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a19bf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568744.090444:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a19bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568744.090538:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788568744.090643:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24926c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+22:11522:x1875449958449536:12345-192.168.206.4@tcp:35:lhsmtool_posix.0 Request processed in 1678us (1970us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1788568744.090653:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 50 00000020:00080000:0.0:1788568744.090658:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788568744.096752:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788568744.096767:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a19bf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568744.096779:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaa800 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:1.0:1788568744.096784:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a19bf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568744.096794:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a19bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568744.096812:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ae24515ac00) 00010000:00010000:1.0:1788568744.096814:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788568744.096819:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a19bf lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568744.096826:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a19bf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568744.096863:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568744.096865:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568744.096883:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568744.119338:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568744.440543:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976271616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788568744.440623:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568744.440949:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976271616 00000100:00100000:1.0:1788568744.440958:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976271616 00000100:00100000:1.0:1788568744.441014:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788568744.441024:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875449976271616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788568744.441047:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1788568744.441114:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875449976271616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568744.441121:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788568744.441258:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976271616:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788568745.143580:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788568745.630774:0:12520:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788568745.630782:0:12520:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788568745.630813:0:12520:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788568745.630819:0:12520:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788568745.835386:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568745.835420:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958449792 00000100:00100000:1.0:1788568745.835430:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958449792 00000100:00100000:1.0:1788568745.835482:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 187 00000100:00100000:1.0:1788568745.835494:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+22:11540:x1875449958449792:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:1.0:1788568745.835516:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568745.835538:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a19c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bed95 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.835629:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a19cd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.835644:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a19cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.835658:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a19cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568745.835679:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788568745.835810:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a19c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed95 expref: 25 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.835828:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a19cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed95 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.835837:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ae2430ad300) 00010000:00010000:1.0:1788568745.835840:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788568745.835843:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2dc00, rc 0) 00000100:00100000:1.0:1788568745.835903:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+24:11540:x1875449958449792:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 412us (525us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1788568745.835911:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 187 00000100:00100000:2.0:1788568745.840427:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568745.841772:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958449920 00000100:00100000:1.0:1788568745.841783:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958449920 00000100:00100000:1.0:1788568745.841856:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 188 00000100:00100000:1.0:1788568745.841866:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bcbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+24:11540:x1875449958449920:12345-192.168.206.4@tcp:34:lfs.0 00010000:00010000:1.0:1788568745.841953:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a19db lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.841971:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a19db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.841982:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a19db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.841997:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a19e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.842105:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a19e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.842114:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a19e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.842471:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a19e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.842480:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a19e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.842487:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a19e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788568745.842540:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a19e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.842554:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a19db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.842560:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a19db lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.842566:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a19db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.842661:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2c200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568745.842666:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a19db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.842674:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a19db lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.842694:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ae2430ad300) 00010000:00010000:1.0:1788568745.842697:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568745.842707:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a19db lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.842714:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a19db lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.842726:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a19e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.842733:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a19e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.842738:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a19e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.842747:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2ca00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568745.842749:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a19e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.842755:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a19e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.842766:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ae25820c400) 00010000:00010000:1.0:1788568745.842769:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568745.842772:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a19e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.842778:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a19e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.842802:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a19e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.842807:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a19e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.842813:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a19e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.842818:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2c000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568745.842820:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a19e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.842827:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a19e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.842834:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae25820ca00) 00010000:00010000:1.0:1788568745.842836:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568745.842839:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a19e9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.842844:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a19e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568745.843110:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bcbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+24:11540:x1875449958449920:12345-192.168.206.4@tcp:34:lfs.0 Request processed in 1243us (2688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568745.843119:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 188 00000100:00100000:2.0:1788568745.925637:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568745.925724:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958450176 00000100:00100000:3.0:1788568745.925733:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958450176 00000100:00100000:3.0:1788568745.925799:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 189 00000100:00100000:3.0:1788568745.925810:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bcbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+24:11543:x1875449958450176:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:3.0:1788568745.925841:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568745.925863:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a19f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bed9c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568745.926266:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a19f7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568745.926284:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a19f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568745.926297:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a19f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568745.926314:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a19fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568745.926322:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a19fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568745.926329:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a19fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568745.926601:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1a05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568745.926611:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1a05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568745.926619:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1a05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788568745.926629:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788568745.926718:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a19f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568745.926726:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a19f7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568745.926739:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a19f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568745.926746:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7b600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568745.926750:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a19f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568745.926758:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a19f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568745.926770:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ae2430ad300) 00010000:00010000:2.0:1788568745.926773:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788568745.926778:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a19f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568745.926785:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a19f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568745.926798:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a19fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568745.926803:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a19fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568745.926809:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a19fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568745.926814:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7aa00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568745.926818:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a19fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568745.926834:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a19fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568745.926842:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ae255fb9c00) 00010000:00010000:2.0:1788568745.926844:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788568745.926847:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a19fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568745.926853:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a19fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568745.926896:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a19f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed9c expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568745.926911:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1a05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed9c expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568745.926918:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae255fb9900) 00010000:00010000:2.0:1788568745.926920:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788568745.926923:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7a600, rc 0) 00000100:00100000:2.0:1788568745.928365:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bcbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+26:11543:x1875449958450176:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 2551us (2731us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1788568745.928376:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 189 00000100:00100000:0.0:1788568745.932309:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568745.932404:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958450304 00000100:00100000:1.0:1788568745.932414:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958450304 00000100:00100000:1.0:1788568745.932509:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 190 00000100:00100000:1.0:1788568745.932530:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+26:11543:x1875449958450304:12345-192.168.206.4@tcp:54:lfs.0 00010000:00010000:1.0:1788568745.932599:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1a13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.932617:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1a13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.932628:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1a13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.932657:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1a13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.932663:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1a13 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.932670:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1a13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.932675:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2ca00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568745.932679:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1a13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.932686:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1a13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.932697:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae255fb9900) 00010000:00010000:1.0:1788568745.932700:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788568745.932704:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1a13 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.932710:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1a13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568745.932790:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+26:11543:x1875449958450304:12345-192.168.206.4@tcp:54:lfs.0 Request processed in 261us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568745.932798:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 190 00000100:00100000:2.0:1788568745.937011:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568745.937206:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958450560 00000100:00100000:3.0:1788568745.937217:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958450560 00000100:00100000:3.0:1788568745.937264:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 51 00000100:00100000:3.0:1788568745.937274:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bcbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+26:11543:x1875449958450560:12345-192.168.206.4@tcp:35:lfs.0 00000100:00100000:3.0:1788568745.937510:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bcbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+27:11543:x1875449958450560:12345-192.168.206.4@tcp:35:lfs.0 Request processed in 235us (507us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788568745.937518:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 51 00000100:00100000:2.0:1788568745.978120:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568745.978286:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958450816 00000100:00100000:1.0:1788568745.978296:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958450816 00000100:00100000:1.0:1788568745.978352:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 191 00000100:00100000:1.0:1788568745.978363:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bcbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+27:11069:x1875449958450816:12345-192.168.206.4@tcp:101:bash.0 00010000:00010000:1.0:1788568745.978386:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568745.978404:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1a1a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beda3 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.978516:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a1a21 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.978530:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1a05 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed9c expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.978539:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a1a21 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.978573:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1a05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed9c expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.978585:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1a05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed9c expref: 28 pid: 5842 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568745.978597:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae14350fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1875449976271744:192.168.206.4@tcp:104: 00000100:00100000:1.0:1788568745.978713:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2503d5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788568745.982519:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae14350fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1875449976271744:192.168.206.4@tcp:104: 00010000:00010000:1.0:1788568745.982556:0:6714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a1a21 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568745.984073:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568745.984611:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958450944 00000100:00100000:3.0:1788568745.984629:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958450944 00010000:00010000:3.0:1788568745.984674:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1a05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed9c expref: 29 pid: 5842 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568745.984723:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 73 00000100:00100000:3.0:1788568745.984740:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281b03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+29:2363:x1875449958450944:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788568745.984753:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568745.984759:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1a05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed9c expref: 29 pid: 5842 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568745.984773:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1a05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed9c expref: 29 pid: 5842 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568745.984794:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1a05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed9c expref: 29 pid: 5842 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568745.984812:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae255fb9900) 00010000:00010000:3.0:1788568745.984837:0:6705:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a1a21 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568745.984846:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a1a21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568745.984854:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a1a21 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568745.984887:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788568745.984977:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281b03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+28:2363:x1875449958450944:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 245us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568745.984985:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 73 00010000:00010000:1.0:1788568745.985758:0:6714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a1a21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.985768:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a1a21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568745.985788:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788568745.985969:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1a1a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beda3 expref: 29 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.985986:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a1a21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beda3 expref: 28 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.985994:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae255fb9900) 00010000:00010000:1.0:1788568745.985996:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788568745.986000:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2c200, rc 0) 00000100:00100000:1.0:1788568745.986115:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bcbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+28:11069:x1875449958450816:12345-192.168.206.4@tcp:101:bash.0 Request processed in 7753us (8003us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1788568745.986123:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 191 00000100:00100000:2.0:1788568745.990343:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568745.990438:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958451200 00000100:00100000:1.0:1788568745.990449:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958451200 00000100:00100000:1.0:1788568745.990612:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 192 00000100:00100000:1.0:1788568745.990624:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bed1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+28:11069:x1875449958451200:12345-192.168.206.4@tcp:36:bash.0 00010000:00010000:1.0:1788568745.991078:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1a2f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.991107:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1a2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.991118:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1a2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788568745.991175:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:1.0:1788568745.991202:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002b151af7 reply state 0000000026f0c5ff transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1a2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568745.991210:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788568745.991261:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:1.0:1788568745.991371:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bed1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+32:11069:x1875449958451200:12345-192.168.206.4@tcp:36:bash.0 Request processed in 749us (1039us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1788568745.991378:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 192 00000020:00080000:1.0:1788568745.991383:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788568745.994821:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568745.995401:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958451328 00000100:00100000:3.0:1788568745.995412:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958451328 00000100:00100000:3.0:1788568745.995477:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 193 00000100:00100000:3.0:1788568745.995488:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bed2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+32:11069:x1875449958451328:12345-192.168.206.4@tcp:101:bash.0 00010000:00010000:3.0:1788568745.995518:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568745.995542:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1a36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bedaa expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568745.995599:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1a36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedaa expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568745.995612:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1a36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedaa expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568745.995631:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae255fb9900) 00010000:00010000:3.0:1788568745.995634:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788568745.995647:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429de600, rc 0) 00000100:00100000:3.0:1788568745.995915:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bed2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+33:11069:x1875449958451328:12345-192.168.206.4@tcp:101:bash.0 Request processed in 427us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568745.995923:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 193 00010000:00010000:1.0:1788568745.996328:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1a2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.996338:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1a2f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.996414:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1a2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.996421:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2d200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568745.996426:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1a2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.996514:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1a2f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.996528:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae255fb9900) 00010000:00010000:1.0:1788568745.996531:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568745.996535:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1a2f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568745.996541:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1a2f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568746.002324:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568746.002597:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958451456 00000100:00100000:1.0:1788568746.002607:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958451456 00000100:00100000:1.0:1788568746.002682:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 58 00000100:00100000:1.0:1788568746.002693:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+7:11069:x1875449958451456:12345-192.168.206.4@tcp:101:bash.0 00010000:00010000:1.0:1788568746.002726:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568746.002748:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acabb383/0x41e82f464b6a1a3d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bedb1 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788568746.002774:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9b64a5, atime: 0x6a9b64a3, ctime: 0x6a9b64a5, blocks: 0xb 00010000:00010000:1.0:1788568746.002796:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=380s v=(0 0) 00010000:00010000:1.0:1788568746.002801:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788568746.002809:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acabb383/0x41e82f464b6a1a3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedb1 expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.002826:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000acabb383/0x41e82f464b6a1a3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedb1 expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.002858:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2ca00, rc 0) 00000100:00100000:1.0:1788568746.002913:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+8:11069:x1875449958451456:12345-192.168.206.4@tcp:101:bash.0 Request processed in 222us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568746.002920:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 58 00000100:00080000:3.0:1788568746.003325:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788568746.007272:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568746.007360:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958451584 00000100:00100000:2.0:1788568746.007369:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958451584 00002000:00010000:2.0:1788568746.007406:0:6696:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1788568746.007411:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae273aa1180 with x1875449958451584 ext(0->18446744073709551615) 00002000:00010000:2.0:1788568746.007422:0:6696:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ae273aa1180. 00000100:00100000:2.0:1788568746.007497:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 5 00000100:00100000:2.0:1788568746.007507:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+8:2364:x1875449958451584:12345-192.168.206.4@tcp:10:bash.0 00002000:00010000:2.0:1788568746.007780:0:6696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788568746.007784:0:6696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788568741 -> 1788568744 00002000:00010000:2.0:1788568746.007787:0:6696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788568739 -> 1788568739 00002000:00010000:2.0:1788568746.007800:0:6696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788568741 -> 1788568744 00002000:00010000:2.0:1788568746.007802:0:6696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788568746.008190:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+9:2364:x1875449958451584:12345-192.168.206.4@tcp:10:bash.0 Request processed in 681us (924us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788568746.008198:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 5 00002000:00010000:2.0:1788568746.008202:0:6696:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1788568746.008205:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae273aa1180 with x1875449958451584 ext(0->18446744073709551615) 00002000:00010000:2.0:1788568746.008211:0:6696:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ae273aa1180. 00000100:00100000:2.0:1788568746.110557:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568746.111316:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958451712 00000100:00100000:1.0:1788568746.111326:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958451712 00000100:00100000:1.0:1788568746.111410:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 194 00000100:00100000:1.0:1788568746.111420:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+32:11557:x1875449958451712:12345-192.168.206.4@tcp:34:lfs.0 00010000:00010000:1.0:1788568746.111492:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1a44 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.111508:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1a44 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.111521:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1a44 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.111536:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1a4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.111543:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1a4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.111549:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1a4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.111777:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1a52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.111798:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1a52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.111805:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1a52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788568746.112076:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:1.0:1788568746.112399:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1a52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.112412:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1a44 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.112419:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1a44 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.112425:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1a44 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.112430:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2d200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568746.112435:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1a44 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.112443:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1a44 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.112454:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ae2430ad300) 00010000:00010000:1.0:1788568746.112457:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568746.112462:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1a44 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.112469:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1a44 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.112492:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1a4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.112499:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1a4b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.112505:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1a4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.112509:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2d600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568746.112511:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1a4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.112517:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1a4b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.112524:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ae25820cf00) 00010000:00010000:1.0:1788568746.112527:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568746.112529:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1a4b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.112534:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1a4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.112548:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1a52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.112554:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1a52 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.112560:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1a52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.112573:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2de00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568746.112576:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1a52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.112582:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1a52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.112591:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae255fb9900) 00010000:00010000:1.0:1788568746.112593:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568746.112596:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1a52 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.112601:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1a52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568746.112688:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+32:11557:x1875449958451712:12345-192.168.206.4@tcp:34:lfs.0 Request processed in 1267us (2140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568746.112697:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 194 00000100:00100000:0.0:1788568746.166388:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568746.166494:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958451968 00000100:00100000:1.0:1788568746.166505:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958451968 00000100:00100000:1.0:1788568746.166561:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 195 00000100:00100000:1.0:1788568746.166572:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae28170a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+32:11560:x1875449958451968:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:1.0:1788568746.166593:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568746.166614:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1a59 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bedb8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.166685:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1a60 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.166719:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1a60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.166742:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1a60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.166760:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1a67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.166767:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1a67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.166773:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1a67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568746.167125:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568746.167147:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a1a6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.167158:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a1a6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.167165:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a1a6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568746.167175:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788568746.167272:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1a60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.167280:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1a60 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.167286:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1a60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.167297:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2d600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568746.167301:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1a60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.167308:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1a60 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.167319:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ae2430ad300) 00010000:00010000:1.0:1788568746.167322:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568746.167326:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1a60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.167333:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1a60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.167345:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1a67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.167351:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1a67 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.167357:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1a67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.167361:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2d200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568746.167364:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1a67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.167369:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1a67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.167388:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ae25820cf00) 00010000:00010000:1.0:1788568746.167391:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568746.167394:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1a67 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.167400:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1a67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.167439:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1a59 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedb8 expref: 35 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.167454:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a1a6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedb8 expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.167460:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae255fb9900) 00010000:00010000:1.0:1788568746.167463:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788568746.167465:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2c400, rc 0) 00000100:00100000:1.0:1788568746.167529:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae28170a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+34:11560:x1875449958451968:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 958us (1150us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1788568746.167536:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 195 00000100:00100000:0.0:1788568746.172325:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568746.172419:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958452096 00000100:00100000:3.0:1788568746.172428:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958452096 00000100:00100000:3.0:1788568746.172504:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 196 00000100:00100000:3.0:1788568746.172516:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277ac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+34:11560:x1875449958452096:12345-192.168.206.4@tcp:54:lfs.0 00010000:00010000:3.0:1788568746.172601:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1a7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568746.172617:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a1a21 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beda3 expref: 34 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568746.172627:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1a7c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568746.172662:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a1a21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beda3 expref: 34 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568746.172677:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a1a21 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beda3 expref: 34 pid: 6714 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568746.172692:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf06300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875449976271872:192.168.206.4@tcp:104: 00000100:00100000:3.0:1788568746.172785:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2487d3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788568746.176502:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568746.176712:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf06300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875449976271872:192.168.206.4@tcp:104: 00010000:00010000:1.0:1788568746.176738:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1a7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568746.178613:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958452352 00000100:00100000:2.0:1788568746.178628:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958452352 00000100:00100000:2.0:1788568746.178767:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 52 00000100:00100000:2.0:1788568746.178779:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+35:5599:x1875449958452352:12345-192.168.206.4@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788568746.179141:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+36:5599:x1875449958452352:12345-192.168.206.4@tcp:35:ldlm_bl.0 Request processed in 364us (2647us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1788568746.179150:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 52 00000100:00100000:1.0:1788568746.182643:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568746.185748:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958452480 00000100:00100000:0.0:1788568746.185764:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958452480 00010000:00010000:0.0:1788568746.185812:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a1a21 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beda3 expref: 36 pid: 6714 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568746.185872:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 74 00000100:00100000:0.0:1788568746.185884:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae14350fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+36:2364:x1875449958452480:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788568746.185900:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568746.185919:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a1a21 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beda3 expref: 36 pid: 6714 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568746.185983:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a1a21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beda3 expref: 36 pid: 6714 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568746.186006:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a1a21 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beda3 expref: 36 pid: 6714 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568746.186024:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae255fb9900) 00010000:00010000:0.0:1788568746.186030:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1a7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568746.186041:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1a7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568746.186048:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1a7c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568746.186086:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788568746.186155:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae14350fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+35:2364:x1875449958452480:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 271us (3519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568746.186163:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 74 00010000:00010000:1.0:1788568746.187764:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1a7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.187799:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1a7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.187834:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1a7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.187841:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1a7c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.187848:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1a7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.187853:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429dea00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568746.187857:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1a7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.187864:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1a7c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.187878:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae255fb9900) 00010000:00010000:1.0:1788568746.187882:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788568746.187886:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1a7c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.187892:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1a7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568746.188013:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277ac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+34:11560:x1875449958452096:12345-192.168.206.4@tcp:54:lfs.0 Request processed in 15495us (15692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568746.188023:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 196 00000100:00100000:1.0:1788568746.191360:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568746.191530:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958452736 00000100:00100000:0.0:1788568746.191548:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958452736 00000100:00100000:0.0:1788568746.191604:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 53 00000100:00100000:0.0:1788568746.191615:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae14350ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+34:11560:x1875449958452736:12345-192.168.206.4@tcp:35:lfs.0 00000100:00100000:0.0:1788568746.191883:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae14350ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+35:11560:x1875449958452736:12345-192.168.206.4@tcp:35:lfs.0 Request processed in 269us (532us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1788568746.191908:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 53 00000100:00100000:3.0:1788568746.345319:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568746.345433:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958452992 00000100:00100000:1.0:1788568746.345443:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958452992 00000100:00100000:1.0:1788568746.345504:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 197 00000100:00100000:1.0:1788568746.345514:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+35:11571:x1875449958452992:12345-192.168.206.4@tcp:101:cat.0 00010000:00010000:1.0:1788568746.345536:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568746.345556:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1a83 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bedbf expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.345620:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1a8a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.345634:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1a8a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.345646:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1a8a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.345660:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2cc00/0x41e82f464b6a1a91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.345668:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2cc00/0x41e82f464b6a1a91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.345675:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2cc00/0x41e82f464b6a1a91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.346014:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a1a98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.346025:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a1a98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.346053:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a1a98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568746.346064:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1788568746.346174:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1a8a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.346183:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1a8a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.346190:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1a8a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.346197:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2d600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568746.346201:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1a8a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.346209:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1a8a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.346222:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ae2430ad300) 00010000:00010000:1.0:1788568746.346225:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568746.346229:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1a8a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.346236:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1a8a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.346248:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2cc00/0x41e82f464b6a1a91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.346254:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2cc00/0x41e82f464b6a1a91 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.346266:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2cc00/0x41e82f464b6a1a91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.346272:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2cc00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568746.346275:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2cc00/0x41e82f464b6a1a91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.346282:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2cc00/0x41e82f464b6a1a91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.346290:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ae25820cf00) 00010000:00010000:1.0:1788568746.346293:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568746.346295:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2cc00/0x41e82f464b6a1a91 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.346302:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2cc00/0x41e82f464b6a1a91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.346338:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1a83 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedbf expref: 38 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.346352:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a1a98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedbf expref: 37 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.346360:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae255fb9900) 00010000:00010000:1.0:1788568746.346363:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788568746.346365:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2c200, rc 0) 00000100:00100000:1.0:1788568746.346431:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+37:11571:x1875449958452992:12345-192.168.206.4@tcp:101:cat.0 Request processed in 918us (1121us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1788568746.346452:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 197 00000100:00100000:3.0:1788568746.360257:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568746.360326:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958453248 00000100:00100000:2.0:1788568746.360337:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958453248 00000100:00100000:2.0:1788568746.360399:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 54 00000100:00100000:2.0:1788568746.360410:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+37:11571:x1875449958453248:12345-192.168.206.4@tcp:35:cat.0 00000100:00100000:2.0:1788568746.360636:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+38:11571:x1875449958453248:12345-192.168.206.4@tcp:35:cat.0 Request processed in 227us (384us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1788568746.360643:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 54 00000100:00100000:0.0:1788568746.408449:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568746.408557:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958453504 00000100:00100000:2.0:1788568746.408567:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958453504 00000100:00100000:2.0:1788568746.408621:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 198 00000100:00100000:2.0:1788568746.408631:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+38:11572:x1875449958453504:12345-192.168.206.4@tcp:36:rm.0 00010000:00010000:2.0:1788568746.408697:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788568746.408721:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a1a98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedbf expref: 38 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.408742:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a1a6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedb8 expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.408753:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1a36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedaa expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.408765:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae255fb9900) 00010000:00010000:2.0:1788568746.408775:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788568746.408797:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1aa6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.408811:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1aa6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.408850:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1aa6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.408864:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1aad lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.408871:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1aad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.408877:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1aad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.409187:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1ab4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.409197:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1ab4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.409204:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1ab4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788568746.409747:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1788568746.409757:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 380817829315ns, next at 381817827185ns, rc = 0 00010000:00010000:2.0:1788568746.409824:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1abb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.409836:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1abb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.409846:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1abb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.409866:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1abb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.409873:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1abb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.409880:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1abb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.409910:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788568746.409963:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1ab4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.409970:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1ab4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.409977:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1ab4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.409982:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7aa00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568746.409987:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1ab4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.409994:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1ab4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.410005:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae255fb9000) 00010000:00010000:2.0:1788568746.410007:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788568746.410010:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1ab4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.410027:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1ab4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.410045:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1aa6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.410051:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1aa6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.410057:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1aa6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.410062:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7b600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568746.410065:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1aa6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.410071:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1aa6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.410080:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ae2430ad300) 00010000:00010000:2.0:1788568746.410083:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788568746.410086:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1aa6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.411137:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788568746.411148:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1abb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.411156:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7ae00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:1.0:1788568746.411160:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1abb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.411168:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1abb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.411181:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ae255fb9000) 00010000:00010000:1.0:1788568746.411183:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788568746.411188:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1abb lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.411194:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1abb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.411216:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568746.411218:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568746.411220:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568746.412294:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1aa6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788568746.412314:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e823452e reply state 00000000f183be3d transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1aad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568746.412324:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788568746.412508:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+37:11572:x1875449958453504:12345-192.168.206.4@tcp:36:rm.0 Request processed in 3872us (4062us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788568746.412517:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 198 00010000:00010000:0.0:1788568746.423065:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1aad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568746.423436:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1aad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568746.423444:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1aad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568746.423450:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7a600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568746.423455:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1aad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568746.423463:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1aad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568746.423478:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ae255fb9c00) 00010000:00010000:0.0:1788568746.423480:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788568746.423484:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1aad lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568746.423489:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1aad lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568746.480736:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568746.480853:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958453760 00000100:00100000:1.0:1788568746.480864:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958453760 00000100:00100000:1.0:1788568746.480960:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 199 00000100:00100000:1.0:1788568746.480972:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277ac7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+36:11578:x1875449958453760:12345-192.168.206.4@tcp:101:bash.0 00010000:00010000:1.0:1788568746.480996:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568746.481015:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1ac2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bedc6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.481175:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2cc00/0x41e82f464b6a1ac9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.481190:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2cc00/0x41e82f464b6a1ac9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.481201:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2cc00/0x41e82f464b6a1ac9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.481214:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1ad0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.481220:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1ad0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.481227:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1ad0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788568746.481710:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1788568746.481873:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1ad7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.481883:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.481895:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.481956:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2cc00/0x41e82f464b6a1ac9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.481975:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2cc00/0x41e82f464b6a1ac9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.481982:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2cc00/0x41e82f464b6a1ac9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.481989:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2cc00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568746.481994:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2cc00/0x41e82f464b6a1ac9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.482003:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2cc00/0x41e82f464b6a1ac9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.482015:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ae2430ad300) 00010000:00010000:1.0:1788568746.482018:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568746.482023:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2cc00/0x41e82f464b6a1ac9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.482029:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2cc00/0x41e82f464b6a1ac9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788568746.482042:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008869a094 reply state 00000000de3ceeaf transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1ad0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568746.482050:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788568746.482077:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1ac2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedc6 expref: 39 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.482107:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1ad7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedc6 expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.482130:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ae25820c600) 00010000:00010000:1.0:1788568746.482132:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788568746.482135:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2de00, rc 0) 00000100:00100000:1.0:1788568746.482205:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277ac7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+39:11578:x1875449958453760:12345-192.168.206.4@tcp:101:bash.0 Request processed in 1236us (1478us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1788568746.482214:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 199 00010000:00010000:2.0:1788568746.485607:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1ad0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.485624:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1ad0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.485631:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1ad0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.485637:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2d600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568746.485642:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1ad0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.485650:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1ad0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.485666:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ae25820cf00) 00010000:00010000:2.0:1788568746.485669:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788568746.485674:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1ad0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.485681:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1ad0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568746.491241:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568746.491694:0:8111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958453888 00000100:00100000:3.0:1788568746.491705:0:8111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958453888 00000100:00100000:3.0:1788568746.491796:0:8111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 59 00000100:00100000:3.0:1788568746.491806:0:8111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2364:x1875449958453888:12345-192.168.206.4@tcp:101:bash.0 00010000:00010000:3.0:1788568746.491833:0:8111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568746.491854:0:8111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006839d0bc/0x41e82f464b6a1ae5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bedcd expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788568746.491880:0:8111:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788568746.491898:0:8111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=380s v=(0 0) 00010000:00010000:3.0:1788568746.491903:0:8111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788568746.491912:0:8111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006839d0bc/0x41e82f464b6a1ae5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedcd expref: 6 pid: 8111 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568746.491969:0:8111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006839d0bc/0x41e82f464b6a1ae5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedcd expref: 6 pid: 8111 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568746.491984:0:8111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429df400, rc 0) 00000100:00100000:3.0:1788568746.492053:0:8111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2364:x1875449958453888:12345-192.168.206.4@tcp:101:bash.0 Request processed in 248us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568746.492061:0:8111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 59 00000100:00080000:2.0:1788568746.492609:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788568746.497377:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568746.497475:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958454016 00000100:00100000:2.0:1788568746.497485:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958454016 00000100:00100000:2.0:1788568746.497543:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 60 00000100:00100000:2.0:1788568746.497553:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae14350c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+6:11578:x1875449958454016:12345-192.168.206.4@tcp:101:bash.0 00010000:00010000:2.0:1788568746.497588:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568746.497608:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d05415af/0x41e82f464b6a1aec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bedd4 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.497642:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006839d0bc/0x41e82f464b6a1ae5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedcd expref: 7 pid: 8111 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.497652:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788568746.497656:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788568746.497661:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d05415af/0x41e82f464b6a1aec lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedd4 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.497695:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006839d0bc/0x41e82f464b6a1ae5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedcd expref: 7 pid: 8111 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.497708:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006839d0bc/0x41e82f464b6a1ae5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedcd expref: 7 pid: 8111 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568746.497732:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1875449976272000:192.168.206.4@tcp:104: 00000100:00100000:2.0:1788568746.497831:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae250ac8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788568746.501574:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568746.501697:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958454144 00000100:00100000:3.0:1788568746.501706:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958454144 00010000:00010000:3.0:1788568746.501754:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006839d0bc/0x41e82f464b6a1ae5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedcd expref: 8 pid: 8111 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568746.501815:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 75 00000100:00100000:3.0:1788568746.501834:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cce7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+8:2364:x1875449958454144:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788568746.501851:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568746.501872:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006839d0bc/0x41e82f464b6a1ae5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedcd expref: 8 pid: 8111 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568746.501888:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006839d0bc/0x41e82f464b6a1ae5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedcd expref: 8 pid: 8111 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568746.501912:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788568746.501916:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788568746.501962:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d05415af/0x41e82f464b6a1aec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedd4 expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568746.501974:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d05415af/0x41e82f464b6a1aec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedd4 expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568746.502011:0:6705:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d05415af/0x41e82f464b6a1aec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedd4 expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568746.502343:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6705:1875449976272128:192.168.206.4@tcp:105: 00000100:00100000:3.0:1788568746.502413:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2487d3c00 going to sleep for 11 seconds 00010000:00010000:2.0:1788568746.503034:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006839d0bc/0x41e82f464b6a1ae5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedcd expref: 8 pid: 8111 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568746.503060:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1875449976272000:192.168.206.4@tcp:104: 00010000:00010000:2.0:1788568746.503099:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d05415af/0x41e82f464b6a1aec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedd4 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.503123:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7b600, rc 0) 00000100:00100000:2.0:1788568746.503180:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae14350c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+7:11578:x1875449958454016:12345-192.168.206.4@tcp:101:bash.0 Request processed in 5627us (5812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568746.503187:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 60 00000100:00100000:0.0:1788568746.508947:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568746.509077:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6705:1875449976272128:192.168.206.4@tcp:105: 00010000:00010000:2.0:1788568746.509112:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568746.509164:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cce7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2364:x1875449958454144:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 7333us (7598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568746.509175:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 75 00000100:00100000:2.0:1788568746.509212:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958454400 00000100:00100000:2.0:1788568746.509217:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958454400 00000100:00100000:2.0:1788568746.509251:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 55 00000100:00100000:2.0:1788568746.509260:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cce6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+38:11578:x1875449958454400:12345-192.168.206.4@tcp:35:bash.0 00000100:00100000:2.0:1788568746.509563:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cce6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+39:11578:x1875449958454400:12345-192.168.206.4@tcp:35:bash.0 Request processed in 303us (650us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1788568746.509570:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 55 00000100:00100000:1.0:1788568746.513291:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568746.513331:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568746.513355:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568746.513483:0:8111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958454656 00000100:00100000:3.0:1788568746.513493:0:8111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958454656 00000100:00100000:3.0:1788568746.513610:0:8111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 95 00000100:00100000:3.0:1788568746.513620:0:8111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae14350c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+9:2361:x1875449958454656:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:3.0:1788568746.513684:0:8111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae14350c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+9:2361:x1875449958454656:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 66us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568746.513692:0:8111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 95 00000100:00100000:0.0:1788568746.513764:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958454528 00000100:00100000:0.0:1788568746.513769:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958454528 00000100:00100000:0.0:1788568746.513797:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 297 00000100:00100000:0.0:1788568746.513804:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae250448050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+13:2361:x1875449958454528:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:0.0:1788568746.513846:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae250448050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f0f084e-5158-464d-a770-11379825208e+13:2361:x1875449958454528:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 42us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568746.513853:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 297 00000100:00100000:2.0:1788568746.514147:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958454784 00000100:00100000:2.0:1788568746.514151:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958454784 00000100:00100000:2.0:1788568746.514187:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 160 00000100:00100000:2.0:1788568746.514194:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277d96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2361:x1875449958454784:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:2.0:1788568746.514227:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277d96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2361:x1875449958454784:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 34us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568746.514234:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 160 00000100:00080000:0.0:1788568746.514632:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788568746.691121:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568746.691289:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958454912 00000100:00100000:2.0:1788568746.691299:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958454912 00000100:00100000:2.0:1788568746.691357:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 200 00000100:00100000:2.0:1788568746.691367:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277d97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+39:11594:x1875449958454912:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:2.0:1788568746.691397:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568746.691418:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1af3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beddb expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.691479:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1afa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.691492:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1afa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.691506:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1afa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788568746.691537:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788568746.691541:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788568746.691559:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1afa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.691582:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1af3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beddb expref: 41 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.691602:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1afa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beddb expref: 40 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.691609:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ae2430ad300) 00010000:00010000:2.0:1788568746.691612:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788568746.691628:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7be00, rc 0) 00000100:00100000:2.0:1788568746.691689:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277d97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+40:11594:x1875449958454912:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 322us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568746.691695:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 200 00000100:00100000:0.0:1788568746.697211:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568746.697354:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958455168 00000100:00100000:2.0:1788568746.697363:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958455168 00000100:00100000:2.0:1788568746.697424:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 201 00000100:00100000:2.0:1788568746.697433:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+40:11594:x1875449958455168:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:2.0:1788568746.697452:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568746.697471:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1b01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bede2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.697569:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1b08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.697582:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1b08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.697593:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1b08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788568746.697603:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788568746.697727:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1b01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bede2 expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.697745:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1b08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bede2 expref: 42 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.697754:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ae25820c600) 00010000:00010000:2.0:1788568746.697769:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788568746.697772:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7b200, rc 0) 00000100:00100000:2.0:1788568746.697843:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+42:11594:x1875449958455168:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 410us (642us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1788568746.697850:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 201 00000100:00100000:0.0:1788568746.703293:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568746.703341:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568746.703424:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958455552 00000100:00100000:1.0:1788568746.703434:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958455552 00000100:00100000:1.0:1788568746.703502:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 14 00000100:00100000:1.0:1788568746.703513:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25319ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+42:2364:x1875449958455552:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788568746.703527:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788568746.703551:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b200/0x41e82f464b6a1b08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bede2 expref: 42 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.703570:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ae25820c600) 00010000:00010000:1.0:1788568746.703575:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788568746.703627:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25319ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+41:2364:x1875449958455552:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 116us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568746.703635:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 14 00000100:00100000:2.0:1788568746.704229:0:12276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958455424 00000100:00100000:2.0:1788568746.704236:0:12276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958455424 00000100:00100000:2.0:1788568746.704277:0:12276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 202 00000100:00100000:2.0:1788568746.704285:0:12276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fec7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27f83c0c-e36b-48ce-9485-80051fd252dc+41:11594:x1875449958455424:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:2.0:1788568746.704304:0:12276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568746.704318:0:12276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1b16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bede9 expref: -99 pid: 12276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.704402:0:12276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1b1d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.704414:0:12276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1b1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.704424:0:12276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1b1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788568746.704436:0:12276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788568746.704558:0:12276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7aa00/0x41e82f464b6a1b16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bede9 expref: 44 pid: 12276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.704573:0:12276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1b1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bede9 expref: 43 pid: 12276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.704600:0:12276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ae25820c600) 00010000:00010000:2.0:1788568746.704602:0:12276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788568746.704605:0:12276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7a200, rc 0) 00000100:00100000:2.0:1788568746.704778:0:12276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fec7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27f83c0c-e36b-48ce-9485-80051fd252dc+43:11594:x1875449958455424:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 492us (1491us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1788568746.704784:0:12276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 202 00000100:00100000:0.0:1788568746.716361:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568746.716467:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958455680 00000100:00100000:2.0:1788568746.716476:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958455680 00000100:00100000:2.0:1788568746.716535:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 61 00000100:00100000:2.0:1788568746.716545:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+6:2361:x1875449958455680:12345-192.168.206.4@tcp:1:lfs.0 00010000:00010000:2.0:1788568746.716587:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000db309c4/0x41e82f464b6a1b2b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.716606:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d05415af/0x41e82f464b6a1aec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedd4 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.716615:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788568746.716619:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788568746.716623:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000db309c4/0x41e82f464b6a1b2b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.716656:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d05415af/0x41e82f464b6a1aec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedd4 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.716670:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d05415af/0x41e82f464b6a1aec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedd4 expref: 6 pid: 6691 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568746.716698:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6690:1875449976272256:192.168.206.4@tcp:104: 00000100:00100000:2.0:1788568746.716786:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae250ac8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788568746.720417:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568746.720572:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958455808 00000100:00100000:0.0:1788568746.720581:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958455808 00002000:00100000:0.0:1788568746.720628:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9ae27bf05880 x1875449958455808/t0(0) o4->27f83c0c-e36b-48ce-9485-80051fd252dc@192.168.206.4@tcp:182/0 lens 504/0 e 0 to 0 dl 1788568757 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788568746.720639:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae27bf05880 with x1875449958455808 ext(0->8) 00010000:00010000:0.0:1788568746.720648:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d05415af/0x41e82f464b6a1aec lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedd4 expref: 7 pid: 6691 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568746.720664:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d05415af/0x41e82f464b6a1aec lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedd4 expref: 7 pid: 6691 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788568746.720673:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ae27bf05880 00000100:00100000:0.0:1788568746.720708:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 3 00000100:00100000:0.0:1788568746.720719:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+7:2364:x1875449958455808:12345-192.168.206.4@tcp:4:lfs.0 00000100:00100000:0.0:1788568746.721249:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+9:2364:x1875449958455808:12345-192.168.206.4@tcp:4:lfs.0 Request processed in 531us (840us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788568746.721258:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 3 00002000:00100000:0.0:1788568746.721265:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9ae27bf05880 x1875449958455808/t4294967308(0) o4->27f83c0c-e36b-48ce-9485-80051fd252dc@192.168.206.4@tcp:182/0 lens 504/448 e 0 to 0 dl 1788568757 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788568746.721273:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae27bf05880 with x1875449958455808 ext(0->8) 00010000:00010000:0.0:1788568746.721279:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d05415af/0x41e82f464b6a1aec lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedd4 expref: 9 pid: 6691 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568746.721291:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d05415af/0x41e82f464b6a1aec lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedd4 expref: 9 pid: 6691 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788568746.721299:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ae27bf05880 00000100:00100000:2.0:1788568746.722042:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6690:1875449976272256:192.168.206.4@tcp:104: 00010000:00010000:2.0:1788568746.722068:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000db309c4/0x41e82f464b6a1b2b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568746.724726:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568746.724814:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958455936 00000100:00100000:3.0:1788568746.724886:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958455936 00010000:00010000:3.0:1788568746.724924:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d05415af/0x41e82f464b6a1aec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedd4 expref: 9 pid: 6691 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568746.724996:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 76 00000100:00100000:3.0:1788568746.725007:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fec5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+9:2364:x1875449958455936:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788568746.725022:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788568746.725038:0:5827:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788568746.725041:0:5827:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788568745 00002000:00010000:3.0:1788568746.725043:0:5827:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788568745 00002000:00010000:3.0:1788568746.725046:0:5827:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788568745 00010000:00010000:3.0:1788568746.725052:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d05415af/0x41e82f464b6a1aec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedd4 expref: 9 pid: 6691 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568746.725065:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d05415af/0x41e82f464b6a1aec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedd4 expref: 9 pid: 6691 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568746.725099:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d05415af/0x41e82f464b6a1aec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedd4 expref: 9 pid: 6691 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568746.725142:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788568746.725146:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788568746.725152:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000db309c4/0x41e82f464b6a1b2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568746.725160:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000db309c4/0x41e82f464b6a1b2b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568746.725978:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788568746.726044:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fec5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+8:2364:x1875449958455936:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 1035us (1324us total) trans 0 rc 0/0 00010000:00010000:0.0:1788568746.726050:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000db309c4/0x41e82f464b6a1b2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568746.726055:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 76 00010000:00010000:0.0:1788568746.726061:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000db309c4/0x41e82f464b6a1b2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568746.726087:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000db309c4/0x41e82f464b6a1b2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568746.726113:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000db309c4/0x41e82f464b6a1b2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568746.726135:0:6690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000db309c4/0x41e82f464b6a1b2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568746.726142:0:6690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7aa00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788568746.726147:0:6690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000db309c4/0x41e82f464b6a1b2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568746.726156:0:6690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000db309c4/0x41e82f464b6a1b2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568746.726170:0:6690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000db309c4/0x41e82f464b6a1b2b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568746.726178:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000db309c4/0x41e82f464b6a1b2b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568746.726220:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+7:2361:x1875449958455680:12345-192.168.206.4@tcp:1:lfs.0 Request processed in 9677us (9869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568746.726227:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 61 00000100:00100000:1.0:1788568746.733056:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568746.733313:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958456192 00000100:00100000:2.0:1788568746.733322:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958456192 00000100:00100000:2.0:1788568746.733369:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 56 00000100:00100000:2.0:1788568746.733379:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24926e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+43:11594:x1875449958456192:12345-192.168.206.4@tcp:35:lfs.0 00000004:00010000:2.0:1788568746.733435:0:5845:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1b1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bede9 expref: 43 pid: 12276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788568746.733654:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1788568746.733702:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1788568746.735521:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1788568746.735603:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1b32 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.735621:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1ad7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedc6 expref: 47 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.735630:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1b32 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.735666:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1ad7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedc6 expref: 47 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.735695:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1ad7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedc6 expref: 47 pid: 5843 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568746.735709:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5845:1875449976272384:192.168.206.4@tcp:104: 00000100:00100000:2.0:1788568746.735789:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae250ac8540 going to sleep for 11 seconds 00000100:00100000:2.0:1788568746.746413:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568746.746501:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958456320 00000100:00100000:1.0:1788568746.746511:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958456320 00010000:00010000:1.0:1788568746.746550:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1ad7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedc6 expref: 48 pid: 5843 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568746.746590:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 77 00000100:00100000:1.0:1788568746.746599:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+48:2364:x1875449958456320:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788568746.746614:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788568746.746620:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1ad7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedc6 expref: 48 pid: 5843 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.746634:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1ad7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedc6 expref: 48 pid: 5843 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.746656:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ae25820c600) 00010000:00010000:1.0:1788568746.746662:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1b32 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.746672:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1b32 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.746680:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1b32 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.746708:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788568746.746762:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+48:2364:x1875449958456320:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 164us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568746.746770:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 77 00010000:00010000:0.0:1788568746.749634:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1ad7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedc6 expref: 47 pid: 5843 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568746.749659:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5845:1875449976272384:192.168.206.4@tcp:104: 00010000:00010000:0.0:1788568746.749688:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1b32 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.750124:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1b32 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.750141:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1b32 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788568746.750261:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1788568746.750540:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:1.0:1788568746.750649:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277d95180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1875449976272512:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788568746.750715:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568746.751067:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2503d53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788568746.751151:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976272512 00000100:00100000:3.0:1788568746.751160:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976272512 00000100:00100000:3.0:1788568746.751271:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788568746.751282:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277d97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5845:x1875449976272512:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788568746.751385:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277d97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5845:x1875449976272512:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 105us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568746.751393:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788568746.751554:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277d95180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1875449976272512:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788568746.752248:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1788568746.752323:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa6d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1875449976272640:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788568746.752438:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788568746.752567:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788568746.752612:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae250ac8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788568746.753616:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976272640 00000100:00100000:3.0:1788568746.753631:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976272640 00000100:00100000:3.0:1788568746.753722:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788568746.753744:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5845:x1875449976272640:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788568746.754021:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5845:x1875449976272640:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 289us (1582us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788568746.754056:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788568746.754114:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa6d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1875449976272640:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788568746.754191:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1788568746.754235:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1b32 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.754245:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1b32 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.754252:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1b32 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.754258:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7ae00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568746.754262:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1b32 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.754280:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1b32 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.754297:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ae25820c600) 00010000:00010000:2.0:1788568746.754300:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788568746.754305:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1b32 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.754313:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1b32 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788568746.754549:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788568746.754723:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1788568746.754735:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 381162807302ns, next at 382162805304ns, rc = 0 00000001:00080000:2.0:1788568746.754742:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1788568746.754778:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ae25820c600) 00010000:00010000:2.0:1788568746.754781:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788568746.754788:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1b1d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bede9 expref: 51 pid: 12276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568746.754911:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24926e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+50:11594:x1875449958456192:12345-192.168.206.4@tcp:35:lfs.0 Request processed in 21532us (21863us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1788568746.754920:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 56 00000020:00080000:2.0:1788568746.754960:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788568746.759846:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568746.760055:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958456448 00000100:00100000:1.0:1788568746.760064:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958456448 00000100:00100000:1.0:1788568746.760369:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 203 00000100:00100000:1.0:1788568746.760384:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+50:11594:x1875449958456448:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:1.0:1788568746.760409:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568746.760434:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a1b39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bedf0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.760494:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a1b39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedf0 expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.760509:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a1b39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedf0 expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.760528:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ae25820c300) 00010000:00010000:1.0:1788568746.760531:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788568746.760535:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2d000, rc 0) 00000100:00100000:1.0:1788568746.760603:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+51:11594:x1875449958456448:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 223us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568746.761314:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 203 00000100:00100000:0.0:1788568746.770238:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568746.770335:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958456704 00000100:00100000:2.0:1788568746.770346:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958456704 00000100:00100000:2.0:1788568746.770404:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 57 00000100:00100000:2.0:1788568746.770414:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+51:11594:x1875449958456704:12345-192.168.206.4@tcp:35:lfs.0 00000100:00100000:2.0:1788568746.770652:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+52:11594:x1875449958456704:12345-192.168.206.4@tcp:35:lfs.0 Request processed in 238us (423us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1788568746.770660:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 57 00000100:00100000:3.0:1788568746.891012:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568746.891233:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958456832 00000100:00100000:1.0:1788568746.891243:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958456832 00000100:00100000:1.0:1788568746.891306:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 204 00000100:00100000:1.0:1788568746.891318:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+52:11604:x1875449958456832:12345-192.168.206.4@tcp:34:lfs.0 00010000:00010000:1.0:1788568746.891391:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1b40 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.891408:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1b40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.891420:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1b40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.891435:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1b47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.891442:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.891448:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.891533:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1b4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.891540:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1b4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.891548:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1b4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788568746.891604:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1b4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.891616:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1b40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.891623:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1b40 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.891629:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1b40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.891634:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2d800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568746.891638:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1b40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.891646:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1b40 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.892340:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ae2430ad300) 00010000:00010000:1.0:1788568746.892343:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568746.892349:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1b40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.892355:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1b40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.892370:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.892377:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1b47 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.892392:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1b47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.892398:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2d400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568746.892401:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1b47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.892407:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1b47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.892416:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ae25820cb00) 00010000:00010000:1.0:1788568746.892418:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568746.892421:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1b47 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.892427:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1b47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.892441:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1b4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.892447:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1b4e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.892452:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1b4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.892457:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2de00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568746.892460:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1b4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.892476:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1b4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.892484:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ae25820c300) 00010000:00010000:1.0:1788568746.892486:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568746.892489:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1b4e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.892494:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1b4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568746.892642:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+52:11604:x1875449958456832:12345-192.168.206.4@tcp:34:lfs.0 Request processed in 1323us (1638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568746.892663:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 204 00000100:00100000:3.0:1788568746.948593:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568746.949133:0:12276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958457088 00000100:00100000:2.0:1788568746.949144:0:12276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958457088 00000100:00100000:2.0:1788568746.949206:0:12276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 205 00000100:00100000:2.0:1788568746.949216:0:12276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27f83c0c-e36b-48ce-9485-80051fd252dc+52:11607:x1875449958457088:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:2.0:1788568746.949238:0:12276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568746.949260:0:12276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1b55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bedf7 expref: -99 pid: 12276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.949335:0:12276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1b5c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.949354:0:12276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1b5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.949367:0:12276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1b5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.949385:0:12276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1b63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.949393:0:12276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1b63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.949401:0:12276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1b63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.949745:0:12276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1b6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.949771:0:12276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1b6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.949779:0:12276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1b6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788568746.949791:0:12276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788568746.950259:0:12276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1b5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.950274:0:12276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1b5c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.950281:0:12276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1b5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.950286:0:12276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7ae00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568746.950291:0:12276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1b5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.950298:0:12276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1b5c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.950310:0:12276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ae2430ad300) 00010000:00010000:2.0:1788568746.950313:0:12276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788568746.950317:0:12276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1b5c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.950323:0:12276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1b5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.950337:0:12276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1b63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.950351:0:12276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1b63 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.950356:0:12276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1b63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.950360:0:12276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7b600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568746.950363:0:12276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1b63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.950369:0:12276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1b63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.950377:0:12276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ae255fb9900) 00010000:00010000:2.0:1788568746.950380:0:12276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788568746.950382:0:12276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1b63 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.950388:0:12276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1b63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.950432:0:12276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1b55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedf7 expref: 55 pid: 12276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.950569:0:12276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1b6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedf7 expref: 54 pid: 12276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568746.950579:0:12276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ae25820c300) 00010000:00010000:2.0:1788568746.950581:0:12276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788568746.950590:0:12276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7a600, rc 0) 00000100:00100000:2.0:1788568746.950907:0:12276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27f83c0c-e36b-48ce-9485-80051fd252dc+54:11607:x1875449958457088:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 1690us (2322us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1788568746.950916:0:12276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 205 00000100:00100000:0.0:1788568746.967341:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568746.967636:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958457216 00000100:00100000:1.0:1788568746.967645:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958457216 00000100:00100000:1.0:1788568746.967710:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 206 00000100:00100000:1.0:1788568746.967720:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+54:11607:x1875449958457216:12345-192.168.206.4@tcp:54:lfs.0 00010000:00010000:1.0:1788568746.967781:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1b78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.967797:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1b78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.967809:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1b78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.967838:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1b78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.967863:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1b78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.967871:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1b78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.967877:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2de00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568746.967881:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1b78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.967889:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1b78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.967901:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ae25820c300) 00010000:00010000:1.0:1788568746.967904:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788568746.967908:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1b78 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568746.967914:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1b78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568746.968138:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+54:11607:x1875449958457216:12345-192.168.206.4@tcp:54:lfs.0 Request processed in 418us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568746.968146:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 206 00000100:00100000:3.0:1788568746.973068:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568746.974420:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958457472 00000100:00100000:2.0:1788568746.974434:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958457472 00000100:00100000:2.0:1788568746.974563:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 58 00000100:00100000:2.0:1788568746.974574:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+54:11607:x1875449958457472:12345-192.168.206.4@tcp:35:lfs.0 00000100:00100000:2.0:1788568746.975212:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+55:11607:x1875449958457472:12345-192.168.206.4@tcp:35:lfs.0 Request processed in 637us (2150us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1788568746.975222:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 58 00000100:00100000:3.0:1788568747.067449:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568747.067568:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958457728 00000100:00100000:1.0:1788568747.067577:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958457728 00000100:00100000:1.0:1788568747.067638:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 207 00000100:00100000:1.0:1788568747.067649:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+55:11617:x1875449958457728:12345-192.168.206.4@tcp:101:bash.0 00010000:00010000:1.0:1788568747.067671:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568747.067687:0:6714:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788568747.067712:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1afa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beddb expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.067733:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ae2430ad300) 00010000:00010000:1.0:1788568747.067739:0:6714:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788568747.067751:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1b7f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bedfe expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.067854:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1b86 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.067868:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1b6a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedf7 expref: 55 pid: 12276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.067877:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1b86 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.067908:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1b6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedf7 expref: 55 pid: 12276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.067921:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1b6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedf7 expref: 55 pid: 12276 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568747.067988:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277d95f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1875449976272768:192.168.206.4@tcp:104: 00000100:00100000:1.0:1788568747.068069:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2503d5540 going to sleep for 11 seconds 00000100:00100000:0.0:1788568747.078125:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568747.078228:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277d95f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1875449976272768:192.168.206.4@tcp:104: 00000100:00100000:2.0:1788568747.078246:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958457856 00000100:00100000:2.0:1788568747.078254:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958457856 00010000:00010000:1.0:1788568747.078266:0:6714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1b86 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568747.078290:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1b6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedf7 expref: 56 pid: 12276 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568747.078335:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 78 00000100:00100000:2.0:1788568747.078345:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fec6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+56:2364:x1875449958457856:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788568747.078363:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568747.078370:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1b6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedf7 expref: 56 pid: 12276 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568747.078383:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1b6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedf7 expref: 56 pid: 12276 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568747.078402:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1b6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedf7 expref: 56 pid: 12276 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568747.078429:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ae25820c300) 00010000:00010000:2.0:1788568747.078434:0:6705:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1b86 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568747.078442:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1b86 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568747.078462:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1b86 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568747.078489:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568747.078544:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fec6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+55:2364:x1875449958457856:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 199us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568747.078551:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 78 00010000:00010000:1.0:1788568747.078914:0:6714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1b86 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.078922:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1b86 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568747.078968:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788568747.079156:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1b7f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedfe expref: 56 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.079173:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1b86 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedfe expref: 55 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.079181:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ae25820c300) 00010000:00010000:1.0:1788568747.079183:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788568747.079186:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2d400, rc 0) 00000100:00100000:1.0:1788568747.079229:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+55:11617:x1875449958457728:12345-192.168.206.4@tcp:101:bash.0 Request processed in 11582us (11789us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1788568747.079237:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 207 00000100:00100000:0.0:1788568747.088036:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568747.088136:0:12276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958458112 00000100:00100000:2.0:1788568747.088146:0:12276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958458112 00000100:00100000:2.0:1788568747.088210:0:12276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 208 00000100:00100000:2.0:1788568747.088220:0:12276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bed2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27f83c0c-e36b-48ce-9485-80051fd252dc+55:11617:x1875449958458112:12345-192.168.206.4@tcp:36:bash.0 00010000:00010000:2.0:1788568747.088473:0:12276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1b94 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568747.088489:0:12276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1b94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568747.088501:0:12276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1b94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788568747.088553:0:12276:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1788568747.088578:0:12276:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f97ca92 reply state 000000008a39e9ff transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1b94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568747.088597:0:12276:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788568747.088695:0:12276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bed2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27f83c0c-e36b-48ce-9485-80051fd252dc+58:11617:x1875449958458112:12345-192.168.206.4@tcp:36:bash.0 Request processed in 475us (670us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1788568747.088702:0:12276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 208 00000020:00080000:2.0:1788568747.088707:0:12276:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788568747.093168:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568747.093274:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958458240 00000100:00100000:1.0:1788568747.093284:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958458240 00010000:00010000:0.0:1788568747.093292:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1b94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568747.093304:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1b94 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568747.093313:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1b94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568747.093319:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7a600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568747.093325:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1b94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568747.093333:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1b94 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568747.093342:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 209 00010000:00010000:0.0:1788568747.093349:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ae25820c300) 00000100:00100000:1.0:1788568747.093355:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+58:11617:x1875449958458240:12345-192.168.206.4@tcp:101:bash.0 00010000:00010000:0.0:1788568747.093356:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788568747.093362:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1b94 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568747.093370:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1b94 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.093386:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568747.093405:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1b9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bee05 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.093515:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1ba2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.093528:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1b86 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedfe expref: 58 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.093536:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1ba2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.093568:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1b86 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedfe expref: 58 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.093581:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1b86 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedfe expref: 58 pid: 6714 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568747.093594:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277d95f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875449976272896:192.168.206.4@tcp:104: 00000100:00100000:1.0:1788568747.093678:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2503d5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788568747.097591:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277d95f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875449976272896:192.168.206.4@tcp:104: 00010000:00010000:1.0:1788568747.097636:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1ba2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568747.099981:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568747.100181:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958458368 00000100:00100000:1.0:1788568747.100191:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958458368 00010000:00010000:1.0:1788568747.100230:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1b86 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedfe expref: 59 pid: 6714 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568747.100265:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 79 00000100:00100000:1.0:1788568747.100288:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+59:2364:x1875449958458368:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788568747.100302:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788568747.100309:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1b86 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedfe expref: 59 pid: 6714 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.100323:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1b86 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedfe expref: 59 pid: 6714 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.100344:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1b86 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedfe expref: 59 pid: 6714 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.100360:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ae25820c300) 00010000:00010000:1.0:1788568747.100365:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1ba2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.100374:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.100381:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1ba2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.100423:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788568747.100492:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+58:2364:x1875449958458368:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 206us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568747.100499:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 79 00010000:00010000:2.0:1788568747.101101:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568747.101113:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788568747.101155:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788568747.101160:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788568747.101183:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568747.101217:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a1b9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee05 expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568747.101234:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee05 expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568747.101242:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ae25820c300) 00010000:00010000:2.0:1788568747.101245:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788568747.101248:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2d800, rc 0) 00000100:00100000:2.0:1788568747.101294:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+57:11617:x1875449958458240:12345-192.168.206.4@tcp:101:bash.0 Request processed in 7942us (8134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568747.101311:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 209 00000100:00100000:2.0:1788568747.109480:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568747.109680:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958458624 00000100:00100000:1.0:1788568747.109689:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958458624 00000100:00100000:1.0:1788568747.109742:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 59 00000100:00100000:1.0:1788568747.109753:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+57:11617:x1875449958458624:12345-192.168.206.4@tcp:35:bash.0 00000100:00100000:1.0:1788568747.110328:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+58:11617:x1875449958458624:12345-192.168.206.4@tcp:35:bash.0 Request processed in 573us (855us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1788568747.110337:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 59 00000100:00100000:3.0:1788568747.176075:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568747.176245:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958458752 00000100:00100000:1.0:1788568747.176254:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958458752 00000100:00100000:1.0:1788568747.176315:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 210 00000100:00100000:1.0:1788568747.176325:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+58:11623:x1875449958458752:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:1.0:1788568747.176348:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568747.176368:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1ba9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bee0c expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.176430:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a1bb0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.176443:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a1bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.176467:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a1bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568747.176501:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788568747.176505:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788568747.176522:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a1bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.176545:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1ba9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee0c expref: 60 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.176563:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a1bb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee0c expref: 59 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.176584:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ae2430ad300) 00010000:00010000:1.0:1788568747.176587:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788568747.176591:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2c000, rc 0) 00000100:00100000:1.0:1788568747.176653:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+59:11623:x1875449958458752:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 330us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568747.176660:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 210 00000100:00100000:0.0:1788568747.179858:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568747.179973:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958458880 00000100:00100000:1.0:1788568747.179983:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958458880 00000100:00100000:1.0:1788568747.180045:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 211 00000100:00100000:1.0:1788568747.180057:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+59:11623:x1875449958458880:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:1.0:1788568747.180078:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568747.180108:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a1bb7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bee13 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.180191:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2cc00/0x41e82f464b6a1bbe lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.180206:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2cc00/0x41e82f464b6a1bbe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.180219:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2cc00/0x41e82f464b6a1bbe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.180235:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1bc5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.180242:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.180260:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.180358:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1bcc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.180367:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1bcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.180374:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1bcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568747.180419:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788568747.180423:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788568747.180455:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1bcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.180469:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1bcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.180477:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2cc00/0x41e82f464b6a1bbe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.180483:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2cc00/0x41e82f464b6a1bbe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.180489:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2cc00/0x41e82f464b6a1bbe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.180496:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2cc00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568747.180500:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2cc00/0x41e82f464b6a1bbe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.180514:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2cc00/0x41e82f464b6a1bbe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.180531:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ae2430ad300) 00010000:00010000:1.0:1788568747.180534:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568747.180539:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2cc00/0x41e82f464b6a1bbe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.180544:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2cc00/0x41e82f464b6a1bbe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.180558:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.180564:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1bc5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.180569:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1bc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.180574:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2d200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568747.180576:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1bc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.180581:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1bc5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.180587:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ae25820cb00) 00010000:00010000:1.0:1788568747.180589:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568747.180592:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1bc5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.180605:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1bc5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.180636:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a1bb7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee13 expref: 61 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.180647:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1bcc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee13 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.180653:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ae25820c300) 00010000:00010000:1.0:1788568747.180655:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788568747.180657:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2d600, rc 0) 00000100:00100000:1.0:1788568747.180719:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+60:11623:x1875449958458880:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 664us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568747.180726:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 211 00000100:00100000:2.0:1788568747.193429:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568747.193511:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958459136 00000100:00100000:1.0:1788568747.193523:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958459136 00000100:00100000:1.0:1788568747.193577:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 212 00000100:00100000:1.0:1788568747.193587:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+60:11623:x1875449958459136:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:1.0:1788568747.193606:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568747.193625:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a1bd3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bee1a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.193714:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1bda lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.193728:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1ba2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee05 expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.193751:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1bcc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee13 expref: 61 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.193759:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1bda lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.193790:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1bcc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee13 expref: 61 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.193802:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1bcc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee13 expref: 61 pid: 5844 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568747.193816:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277d95f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875449976273024:192.168.206.4@tcp:104: 00010000:00010000:1.0:1788568747.193918:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee05 expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.193952:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1ba2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee05 expref: 61 pid: 5843 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568747.193962:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277d95180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875449976273152:192.168.206.4@tcp:104: 00000100:00100000:1.0:1788568747.193985:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2503d5e40 going to sleep for 11 seconds 00010000:00010000:0.0:1788568747.194095:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568747.198682:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568747.198978:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958459264 00000100:00100000:2.0:1788568747.198990:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958459264 00010000:00010000:2.0:1788568747.199055:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1bcc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee13 expref: 62 pid: 5844 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568747.199107:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 80 00000100:00100000:2.0:1788568747.199117:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+62:2364:x1875449958459264:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788568747.199134:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568747.199142:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1bcc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee13 expref: 62 pid: 5844 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568747.199156:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1bcc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee13 expref: 62 pid: 5844 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568747.199181:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ae25820c300) 00010000:00010000:2.0:1788568747.199186:0:6705:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1bda lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568747.199195:0:6705:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1bda lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568747.199202:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568747.199253:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+62:2364:x1875449958459264:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 138us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568747.199277:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 80 00000100:00100000:3.0:1788568747.202882:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568747.202971:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958459392 00000100:00100000:0.0:1788568747.202981:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958459392 00010000:00010000:0.0:1788568747.203017:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1ba2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee05 expref: 62 pid: 5843 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568747.203064:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 81 00000100:00100000:0.0:1788568747.203073:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+62:2363:x1875449958459392:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788568747.203096:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568747.203103:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1ba2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee05 expref: 62 pid: 5843 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568747.203115:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1ba2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee05 expref: 62 pid: 5843 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568747.203135:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ae25820c300) 00010000:00010000:0.0:1788568747.203141:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1bda lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568747.203150:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1bda lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568747.203157:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1bda lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568747.203176:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788568747.203233:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+62:2363:x1875449958459392:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 161us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568747.203240:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 81 00010000:00010000:1.0:1788568747.203430:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1ba2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee05 expref: 61 pid: 5843 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568747.203446:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277d95180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875449976273152:192.168.206.4@tcp:104: 00010000:00010000:2.0:1788568747.208625:0:5843:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.4@tcp) returned -22 from blocking AST (req@0000000065342892 x1875449976273024) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1bcc lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee13 expref: 60 pid: 5844 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568747.208651:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1bcc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee13 expref: 60 pid: 5844 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568747.208669:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277d95f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875449976273024:192.168.206.4@tcp:104: 00010000:00010000:2.0:1788568747.208701:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ae25820c300) 00010000:00010000:2.0:1788568747.208709:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1bda lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568747.208718:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1bda lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568747.208724:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1bda lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788568747.208745:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788568747.208911:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a1bd3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee1a expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568747.208960:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1bda lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee1a expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568747.208968:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ae25820c300) 00010000:00010000:2.0:1788568747.208971:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788568747.208985:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2d200, rc 0) 00000100:00100000:2.0:1788568747.209046:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+60:11623:x1875449958459136:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 15460us (15626us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1788568747.209054:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 212 00000100:00100000:2.0:1788568747.215231:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568747.215511:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958459648 00000100:00100000:3.0:1788568747.215522:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958459648 00000100:00100000:3.0:1788568747.215592:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 15 00000100:00100000:3.0:1788568747.215603:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25319dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+60:11623:x1875449958459648:12345-192.168.206.4@tcp:103:lfs.0 00010000:00010000:3.0:1788568747.215617:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568747.215639:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a1b39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedf0 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568747.215657:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ae25820c300) 00010000:00010000:3.0:1788568747.215662:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788568747.215719:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25319dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+59:11623:x1875449958459648:12345-192.168.206.4@tcp:103:lfs.0 Request processed in 118us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568747.215727:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 15 00000100:00100000:3.0:1788568747.218374:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568747.218476:0:12276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958459776 00000100:00100000:2.0:1788568747.218484:0:12276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958459776 00000100:00100000:2.0:1788568747.218576:0:12276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 213 00000100:00100000:2.0:1788568747.218586:0:12276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27f83c0c-e36b-48ce-9485-80051fd252dc+59:11623:x1875449958459776:12345-192.168.206.4@tcp:58:lfs.0 00010000:00010000:2.0:1788568747.218679:0:12276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1be8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568747.218695:0:12276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1be8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568747.218706:0:12276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1be8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788568747.218921:0:12276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1788568747.219024:0:12276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27f83c0c-e36b-48ce-9485-80051fd252dc+59:11623:x1875449958459776:12345-192.168.206.4@tcp:58:lfs.0 Request processed in 438us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568747.219031:0:12276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 213 00000100:00100000:2.0:1788568747.225246:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568747.225381:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958459904 00000100:00100000:1.0:1788568747.225391:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958459904 00000100:00100000:1.0:1788568747.225684:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 214 00000100:00100000:1.0:1788568747.225696:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+59:11623:x1875449958459904:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:1.0:1788568747.225716:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568747.225738:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1bef lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bee21 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.225796:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1be8 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.225807:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1bef lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee21 expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.225839:0:5842:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1be8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.225861:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1bef lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee21 expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.225875:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ae25820c300) 00010000:00010000:1.0:1788568747.225878:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788568747.225882:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1bef lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee21 expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568747.225891:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2d800, rc 0) 00000100:00100000:1.0:1788568747.226095:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+60:11623:x1875449958459904:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 392us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568747.226118:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 214 00010000:00010000:3.0:1788568748.215161:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788568748.215898:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788568748.215905:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788568748.215965:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1788568748.216698:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788568748.217153:0:11686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277d95f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11686:1875449976273280:192.168.206.4@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788568748.217566:0:11686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2503d5540 going to sleep for 11 seconds 00000100:00100000:1.0:1788568748.223965:0:11686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277d95f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11686:1875449976273280:192.168.206.4@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788568748.224274:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568748.224444:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958460032 00000100:00100000:2.0:1788568748.224451:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958460032 00000100:00100000:2.0:1788568748.224513:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 215 00000100:00100000:2.0:1788568748.224522:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+60:11625:x1875449958460032:12345-192.168.206.4@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788568748.224557:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00080000:0.0:1788568748.224594:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788568748.224651:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+60:11625:x1875449958460032:12345-192.168.206.4@tcp:53:lhsmtool_posix.0 Request processed in 129us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568748.224665:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 215 00000100:00100000:2.0:1788568748.239287:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568748.239366:0:12276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958460160 00000100:00100000:0.0:1788568748.239376:0:12276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958460160 00000100:00100000:0.0:1788568748.239432:0:12276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 216 00000100:00100000:0.0:1788568748.239442:0:12276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27f83c0c-e36b-48ce-9485-80051fd252dc+60:11625:x1875449958460160:12345-192.168.206.4@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788568748.239515:0:12276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1bf6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.239530:0:12276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1bf6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.239555:0:12276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1bf6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.239570:0:12276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1bfd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.239577:0:12276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1bfd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.239583:0:12276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1bfd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.239604:0:12276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1c04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.239612:0:12276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1c04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.239619:0:12276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1c04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788568748.239679:0:12276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788568748.239683:0:12276:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788568748.239695:0:12276:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1c04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.239706:0:12276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1bf6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.239711:0:12276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1bf6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.239716:0:12276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1bf6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.239721:0:12276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaa400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568748.239725:0:12276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1bf6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.239731:0:12276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1bf6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.239741:0:12276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ae25820cd00) 00010000:00010000:0.0:1788568748.239744:0:12276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788568748.239748:0:12276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1bf6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.239753:0:12276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1bf6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.239764:0:12276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1bfd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.239779:0:12276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1bfd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.239784:0:12276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1bfd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.239789:0:12276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaa800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568748.239792:0:12276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1bfd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.239798:0:12276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1bfd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.239806:0:12276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9ae24515a500) 00010000:00010000:0.0:1788568748.239820:0:12276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788568748.239824:0:12276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1bfd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.239830:0:12276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1bfd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.239845:0:12276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1c04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.239850:0:12276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1c04 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.239855:0:12276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1c04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.239860:0:12276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaa200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568748.239868:0:12276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1c04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.239874:0:12276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1c04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.239882:0:12276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ae25820c300) 00010000:00010000:0.0:1788568748.239884:0:12276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788568748.239887:0:12276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1c04 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.239893:0:12276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1c04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568748.239998:0:12276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27f83c0c-e36b-48ce-9485-80051fd252dc+60:11625:x1875449958460160:12345-192.168.206.4@tcp:34:lhsmtool_posix.0 Request processed in 557us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568748.240006:0:12276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 216 00000100:00100000:3.0:1788568748.252061:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568748.252179:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958460416 00000100:00100000:0.0:1788568748.252188:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958460416 00000100:00100000:0.0:1788568748.252243:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 217 00000100:00100000:0.0:1788568748.252252:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+60:11625:x1875449958460416:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788568748.252269:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568748.252286:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1c0b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bee28 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.252367:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1c12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.252379:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1c12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.252407:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1c12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788568748.252419:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788568748.252505:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1c12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.252513:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1c12 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.252519:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1c12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.252525:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaa800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568748.252530:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1c12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.252854:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1c12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.252867:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ae25820c300) 00010000:00010000:0.0:1788568748.252869:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788568748.252874:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1c12 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.252880:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1c12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.252921:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1c0b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee28 expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.252992:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ae25820cd00) 00010000:00010000:0.0:1788568748.252995:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788568748.252999:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1c0b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee28 expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.253010:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae27feaa200, rc 0) 00000100:00100000:0.0:1788568748.253129:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+61:11625:x1875449958460416:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 878us (1075us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1788568748.253137:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 217 00000100:00100000:3.0:1788568748.262491:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568748.263382:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958460544 00000100:00100000:2.0:1788568748.263393:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958460544 00000100:00100000:2.0:1788568748.263457:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 218 00000100:00100000:2.0:1788568748.263468:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fec5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+61:11625:x1875449958460544:12345-192.168.206.4@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788568748.264476:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788568748.264776:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fec5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+61:11625:x1875449958460544:12345-192.168.206.4@tcp:53:lhsmtool_posix.0 Request processed in 1307us (2291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568748.264787:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 218 00000100:00100000:2.0:1788568748.274510:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568748.274761:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958460800 00000100:00100000:1.0:1788568748.274770:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958460800 00000100:00100000:1.0:1788568748.274831:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 219 00000100:00100000:1.0:1788568748.274841:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+61:11625:x1875449958460800:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788568748.274860:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568748.274863:0:6714:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788568748.274885:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a1bb0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee0c expref: 61 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568748.274906:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ae2430ad300) 00010000:00010000:1.0:1788568748.274911:0:6714:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788568748.274924:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1c20 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bee2f expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788568748.275875:0:6714:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:1.0:1788568748.276104:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a1c27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568748.276137:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a1c27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568748.276490:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a1c27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568748.276555:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1c20 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee2f expref: 63 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568748.276572:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a1c27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee2f expref: 62 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568748.276581:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ae25820cb00) 00010000:00010000:1.0:1788568748.276583:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788568748.276586:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2c400, rc 0) 00000100:00100000:1.0:1788568748.276672:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+62:11625:x1875449958460800:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 1831us (2170us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1788568748.276680:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 219 00000100:00100000:3.0:1788568748.283646:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568748.283757:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958461056 00000100:00100000:0.0:1788568748.283766:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958461056 00000100:00100000:0.0:1788568748.283832:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 220 00000100:00100000:0.0:1788568748.283842:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fec6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+62:11625:x1875449958461056:12345-192.168.206.4@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788568748.283893:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568748.283917:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a1c27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee2f expref: 62 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.283955:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ae25820cb00) 00010000:00010000:0.0:1788568748.283967:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788568748.283986:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1c35 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.283998:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1c35 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.284008:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1c35 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.284041:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1c3c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x3016d4b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.284049:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1c3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3016d4b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.284056:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1c3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3016d4b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.284124:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1c35 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.284293:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1c35 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.284300:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1c35 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.284306:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaa200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568748.284310:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1c35 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.284317:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1c35 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.284325:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ae2430ad300) 00010000:00010000:0.0:1788568748.284327:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788568748.284331:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1c35 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.284337:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa200/0x41e82f464b6a1c35 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.284354:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1c3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3016d4b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.284360:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1c3c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3016d4b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.284364:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1c3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3016d4b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.284369:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaa800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568748.284372:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1c3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3016d4b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.284378:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1c3c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3016d4b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.284385:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x3016d4b5 (ffff9ae24515a500) 00010000:00010000:0.0:1788568748.284388:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788568748.284390:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1c3c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x3016d4b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.284397:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1c3c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x3016d4b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568748.284521:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fec6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+61:11625:x1875449958461056:12345-192.168.206.4@tcp:36:lhsmtool_posix.0 Request processed in 679us (881us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788568748.284529:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 220 00000100:00100000:3.0:1788568748.290159:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568748.290744:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958461184 00000100:00100000:2.0:1788568748.290755:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958461184 00000100:00100000:2.0:1788568748.290828:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 221 00000100:00100000:2.0:1788568748.290838:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273982300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+61:11625:x1875449958461184:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788568748.290860:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568748.290884:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1c43 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bee36 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.290919:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1c4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.290974:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1c4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.290987:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1c4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.291110:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7b600/0x41e82f464b6a1c43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee36 expref: 63 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.291366:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1c4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee36 expref: 62 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.291377:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ae255fb9600) 00010000:00010000:2.0:1788568748.291379:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788568748.291383:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7a200, rc 0) 00000100:00100000:2.0:1788568748.291452:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273982300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+62:11625:x1875449958461184:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 615us (1301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568748.291459:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 221 00000100:00100000:2.0:1788568748.302040:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568748.302138:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958461440 00000100:00100000:1.0:1788568748.302148:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958461440 00000100:00100000:1.0:1788568748.302203:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 222 00000100:00100000:1.0:1788568748.302212:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+62:11625:x1875449958461440:12345-192.168.206.4@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788568748.302285:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1c51 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568748.302302:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1c51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568748.302329:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1c51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788568748.302554:0:6714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:1.0:1788568748.302563:0:6714:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 382710635601ns, next at 383710633519ns, rc = 0 00000004:00010000:1.0:1788568748.302649:0:6714:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005ec4311d reply state 000000000ff58d00 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1c51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568748.302658:0:6714:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788568748.302748:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+64:11625:x1875449958461440:12345-192.168.206.4@tcp:36:lhsmtool_posix.0 Request processed in 536us (726us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1788568748.302755:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 222 00010000:00010000:2.0:1788568748.304563:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1c51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.304578:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1c51 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.304586:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1c51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.304592:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2d400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568748.304596:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1c51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.304616:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1c51 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.304652:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ae255fb9600) 00010000:00010000:2.0:1788568748.304655:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788568748.304660:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1c51 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.304666:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a1c51 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568748.306503:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568748.306579:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958461568 00000100:00100000:0.0:1788568748.306589:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958461568 00000100:00100000:0.0:1788568748.306644:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 223 00000100:00100000:0.0:1788568748.306661:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+63:11625:x1875449958461568:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788568748.306692:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568748.306711:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1c58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bee3d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.306770:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1c58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee3d expref: 64 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.306786:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1c58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee3d expref: 64 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.306805:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ae255fb9600) 00010000:00010000:0.0:1788568748.306808:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788568748.306817:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae27feaa800, rc 0) 00000100:00100000:0.0:1788568748.306880:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+64:11625:x1875449958461568:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 220us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568748.306887:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 223 00000100:00100000:3.0:1788568748.309493:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568748.309609:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958461696 00000100:00100000:2.0:1788568748.309618:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958461696 00000100:00100000:2.0:1788568748.309678:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 62 00000100:00100000:2.0:1788568748.309688:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+9:2364:x1875449958461696:12345-192.168.206.4@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788568748.309988:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+10:2364:x1875449958461696:12345-192.168.206.4@tcp:2:lhsmtool_posix.0 Request processed in 300us (503us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1788568748.309995:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 62 00000100:00080000:0.0:1788568748.310513:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788568748.316389:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568748.316489:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958461952 00000100:00100000:2.0:1788568748.316499:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958461952 00000100:00100000:2.0:1788568748.316556:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 60 00000100:00100000:2.0:1788568748.316566:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+64:11625:x1875449958461952:12345-192.168.206.4@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788568748.316772:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+65:11625:x1875449958461952:12345-192.168.206.4@tcp:35:lhsmtool_posix.0 Request processed in 207us (391us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1788568748.316779:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 60 00000100:00100000:2.0:1788568748.320279:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568748.320375:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958462208 00000100:00100000:1.0:1788568748.320384:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958462208 00000100:00100000:1.0:1788568748.320438:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 224 00000100:00100000:1.0:1788568748.320448:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+65:11625:x1875449958462208:12345-192.168.206.4@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788568748.320556:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+65:11625:x1875449958462208:12345-192.168.206.4@tcp:57:lhsmtool_posix.0 Request processed in 109us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568748.320562:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 224 00000100:00100000:3.0:1788568748.323351:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568748.323569:0:12276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958462336 00000100:00100000:2.0:1788568748.323578:0:12276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958462336 00000100:00100000:2.0:1788568748.323649:0:12276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 225 00000100:00100000:2.0:1788568748.323659:0:12276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273980700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27f83c0c-e36b-48ce-9485-80051fd252dc+65:11625:x1875449958462336:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788568748.323679:0:12276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568748.323701:0:12276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1c5f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bee44 expref: -99 pid: 12276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.323788:0:12276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1c66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.323801:0:12276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1c66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.323813:0:12276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1c66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788568748.323859:0:12276:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788568748.323877:0:12276:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1c66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.323902:0:12276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a600/0x41e82f464b6a1c5f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee44 expref: 67 pid: 12276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.323920:0:12276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1c66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee44 expref: 66 pid: 12276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.323976:0:12276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ae255fb9600) 00010000:00010000:2.0:1788568748.323979:0:12276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788568748.323982:0:12276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7be00, rc 0) 00000100:00100000:2.0:1788568748.324039:0:12276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273980700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27f83c0c-e36b-48ce-9485-80051fd252dc+66:11625:x1875449958462336:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 381us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568748.324055:0:12276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 225 00000100:00100000:3.0:1788568748.328740:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568748.329401:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958462464 00000100:00100000:1.0:1788568748.329410:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958462464 00000100:00100000:1.0:1788568748.329580:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 63 00000100:00100000:1.0:1788568748.329591:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273983b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+10:2363:x1875449958462464:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788568748.329671:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568748.329693:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc3af199/0x41e82f464b6a1c6d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bee4b expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788568748.329746:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b64ab, blocks: 0x1 00010000:00010000:1.0:1788568748.329764:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=382s v=(0 0) 00010000:00010000:1.0:1788568748.329769:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788568748.329777:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc3af199/0x41e82f464b6a1c6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee4b expref: 11 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568748.329794:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fc3af199/0x41e82f464b6a1c6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee4b expref: 11 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568748.329807:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2c000, rc 0) 00000100:00100000:1.0:1788568748.329872:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273983b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+11:2363:x1875449958462464:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 283us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568748.329879:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 63 00000100:00100000:3.0:1788568748.334462:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568748.334681:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958462720 00000100:00100000:1.0:1788568748.334692:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958462720 00000100:00100000:1.0:1788568748.334753:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 226 00000100:00100000:1.0:1788568748.334764:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273981880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+66:11625:x1875449958462720:12345-192.168.206.4@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788568748.334876:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273981880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+66:11625:x1875449958462720:12345-192.168.206.4@tcp:57:lhsmtool_posix.0 Request processed in 114us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568748.334883:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 226 00000100:00100000:3.0:1788568748.338321:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568748.338407:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958462848 00000100:00100000:2.0:1788568748.338416:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958462848 00000100:00100000:2.0:1788568748.338466:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 64 00000100:00100000:2.0:1788568748.338476:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+11:11625:x1875449958462848:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788568748.338493:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568748.338510:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007dbf13f1/0x41e82f464b6a1c74 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bee52 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.338540:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc3af199/0x41e82f464b6a1c6d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee4b expref: 12 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.338548:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788568748.338552:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788568748.338556:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007dbf13f1/0x41e82f464b6a1c74 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee52 expref: 12 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.338586:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fc3af199/0x41e82f464b6a1c6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee4b expref: 12 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.338598:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fc3af199/0x41e82f464b6a1c6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee4b expref: 12 pid: 6691 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568748.338610:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6688:1875449976273408:192.168.206.4@tcp:104: 00000100:00100000:2.0:1788568748.338695:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae250ac8780 going to sleep for 11 seconds 00000100:00100000:3.0:1788568748.342148:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568748.342220:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958462976 00000100:00100000:0.0:1788568748.342229:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958462976 00000100:00100000:2.0:1788568748.342248:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6688:1875449976273408:192.168.206.4@tcp:104: 00010000:00010000:0.0:1788568748.342263:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fc3af199/0x41e82f464b6a1c6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee4b expref: 13 pid: 6691 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.342275:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007dbf13f1/0x41e82f464b6a1c74 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee52 expref: 13 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.342291:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7a600, rc 0) 00000100:00100000:0.0:1788568748.342298:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 82 00000100:00100000:0.0:1788568748.342306:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273980e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+13:2364:x1875449958462976:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788568748.342319:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788568748.342335:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+13:11625:x1875449958462848:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 3861us (4022us total) trans 0 rc 0/0 00010000:00010000:0.0:1788568748.342337:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fc3af199/0x41e82f464b6a1c6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee4b expref: 13 pid: 6691 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568748.342342:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 64 00010000:00010000:0.0:1788568748.342361:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fc3af199/0x41e82f464b6a1c6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee4b expref: 12 pid: 6691 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.342383:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc3af199/0x41e82f464b6a1c6d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee4b expref: 12 pid: 6691 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.342395:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788568748.342399:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788568748.342407:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007dbf13f1/0x41e82f464b6a1c74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee52 expref: 11 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.342417:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007dbf13f1/0x41e82f464b6a1c74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee52 expref: 11 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.342446:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007dbf13f1/0x41e82f464b6a1c74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee52 expref: 11 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568748.342459:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244b35500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5828:1875449976273536:192.168.206.4@tcp:105: 00000100:00100000:0.0:1788568748.342504:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae244836c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788568748.350871:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568748.350978:0:11980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958463104 00000100:00100000:2.0:1788568748.350988:0:11980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958463104 00002000:00100000:2.0:1788568748.351043:0:11980:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9ae277971180 x1875449958463104/t0(0) o4->27f83c0c-e36b-48ce-9485-80051fd252dc@192.168.206.4@tcp:184/0 lens 504/0 e 0 to 0 dl 1788568759 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788568748.351054:0:11980:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae277971180 with x1875449958463104 ext(0->12) 00002000:00010000:2.0:1788568748.351060:0:11980:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ae277971180 00000100:00100000:2.0:1788568748.351096:0:11980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 6 00000100:00100000:2.0:1788568748.351106:0:11980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277971180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+12:2364:x1875449958463104:12345-192.168.206.4@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788568748.351616:0:11980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277971180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+14:2364:x1875449958463104:12345-192.168.206.4@tcp:4:lhsmtool_posix.0 Request processed in 509us (752us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788568748.351624:0:11980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 6 00002000:00100000:2.0:1788568748.351633:0:11980:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9ae277971180 x1875449958463104/t4294967320(0) o4->27f83c0c-e36b-48ce-9485-80051fd252dc@192.168.206.4@tcp:184/0 lens 504/448 e 0 to 0 dl 1788568759 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788568748.351641:0:11980:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae277971180 with x1875449958463104 ext(0->12) 00002000:00010000:2.0:1788568748.351644:0:11980:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ae277971180 00000100:00100000:1.0:1788568748.353649:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244b35500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5828:1875449976273536:192.168.206.4@tcp:105: 00010000:00010000:1.0:1788568748.353675:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788568748.353739:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273980e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+13:2364:x1875449958462976:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 11433us (11597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568748.353765:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 82 00000100:00100000:0.0:1788568748.357196:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568748.357384:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958463232 00000100:00100000:2.0:1788568748.357406:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958463232 00000100:00100000:2.0:1788568748.357463:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 227 00000100:00100000:2.0:1788568748.357474:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cd85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+66:11625:x1875449958463232:12345-192.168.206.4@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788568748.394916:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967503 is committed 00000001:00080000:3.0:1788568748.395191:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:3.0:1788568748.395199:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000001:00080000:3.0:1788568748.395238:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:3.0:1788568748.395257:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1788568748.395281:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ae250ac8840 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1788568748.395285:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ae250422f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ae250ac8cc0 00000020:00080000:3.0:1788568748.395288:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ae250422900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ae277976c00 00000004:00080000:3.0:1788568748.395310:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:3.0:1788568748.395332:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ae26f6a3300 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1788568748.395336:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ae281777800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ae26f6a3780 00000020:00080000:3.0:1788568748.395338:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ae281777400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ae26f79c000 00000100:00100000:2.0:1788568748.395522:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976273792:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788568748.395581:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568748.395616:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788568748.395623:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976273664:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788568748.395644:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568748.395674:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976273792 00000100:00100000:2.0:1788568748.395680:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976273792 00000100:00100000:2.0:1788568748.395727:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976273664 00000100:00100000:2.0:1788568748.395730:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976273664 00000100:00100000:2.0:1788568748.395750:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788568748.395758:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3309:x1875449976273792:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788568748.395991:0:8111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788568748.396001:0:8111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3309:x1875449976273664:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788568748.396020:0:8111:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:3.0:1788568748.396125:0:8111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006839d0bc/0x41e82f464b6a1c7b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568748.396146:0:8111:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000acabb383/0x41e82f464b6a1a3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedb1 expref: 12 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568748.396170:0:8111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788568748.396174:0:8111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788568748.396179:0:8111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006839d0bc/0x41e82f464b6a1c7b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568748.396207:0:8111:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000acabb383/0x41e82f464b6a1a3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedb1 expref: 12 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568748.396220:0:8111:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000acabb383/0x41e82f464b6a1a3d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedb1 expref: 12 pid: 6691 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568748.396232:0:8111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273982a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8111:1875449976273920:192.168.206.4@tcp:104: 00000100:00100000:3.0:1788568748.396292:0:8111:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2487d39c0 going to sleep for 11 seconds 00002000:00010000:2.0:1788568748.397479:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788568748.397486:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788568747 00002000:00010000:2.0:1788568748.397489:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788568748.397492:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788568747 -> 1788568747 00002000:00010000:2.0:1788568748.397494:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788568748.397557:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3309:x1875449976273792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1798us (1973us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1788568748.397565:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:2.0:1788568748.397621:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ae2739f1500/2, rc 0, transno 4294967321 00000100:00100000:2.0:1788568748.397628:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976273792:0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1788568748.398503:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788568748.401012:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27cd87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976274048:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788568748.401752:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568748.401832:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976274048 00000100:00100000:2.0:1788568748.401839:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976274048 00000100:00100000:2.0:1788568748.401885:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788568748.401894:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1875449976274048:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788568748.401923:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:2.0:1788568748.401983:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9b64a9, atime: 0x6a9b64a9, ctime: 0x6a9b64a9, blocks: 0x1 00010000:00010000:2.0:1788568748.401991:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000db309c4/0x41e82f464b6a1c82 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.402005:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=382s v=(0 0) 00010000:00010000:2.0:1788568748.402009:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788568748.402015:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000db309c4/0x41e82f464b6a1c82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.402041:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000db309c4/0x41e82f464b6a1c82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.402052:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000db309c4/0x41e82f464b6a1c82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.402059:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000db309c4/0x41e82f464b6a1c82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.402077:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788568748.402581:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3306:x1875449976274048:12345-0@lo:6:osp-syn-1-0.0 Request processed in 688us (830us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788568748.402590:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:2.0:1788568748.402626:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788568748.402632:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000db309c4/0x41e82f464b6a1c82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.402640:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7aa00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:2.0:1788568748.402645:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000db309c4/0x41e82f464b6a1c82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.402654:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000db309c4/0x41e82f464b6a1c82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.402668:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000db309c4/0x41e82f464b6a1c82 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.402676:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000db309c4/0x41e82f464b6a1c82 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.402694:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568748.402696:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568748.402698:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788568748.402729:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ae27cd87480/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788568748.402735:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27cd87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976274048:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788568748.403327:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cd85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+20:11625:x1875449958463232:12345-192.168.206.4@tcp:44:lhsmtool_posix.0 Request processed in 45851us (46136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568748.403337:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 227 00000020:00080000:1.0:1788568748.403358:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1788568748.403517:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00080000:2.0:1788568748.403613:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788568748.404459:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568748.404582:0:8111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273982a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8111:1875449976273920:192.168.206.4@tcp:104: 00010000:00010000:2.0:1788568748.404608:0:8111:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006839d0bc/0x41e82f464b6a1c7b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568748.405280:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958463360 00000100:00100000:1.0:1788568748.405290:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958463360 00010000:00010000:1.0:1788568748.405323:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000acabb383/0x41e82f464b6a1a3d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedb1 expref: 13 pid: 6691 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568748.405354:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 83 00000100:00100000:1.0:1788568748.405364:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cd86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+13:2363:x1875449958463360:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788568748.405377:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788568748.405382:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000acabb383/0x41e82f464b6a1a3d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedb1 expref: 13 pid: 6691 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568748.405394:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000acabb383/0x41e82f464b6a1a3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedb1 expref: 13 pid: 6691 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568748.405415:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acabb383/0x41e82f464b6a1a3d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bedb1 expref: 13 pid: 6691 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568748.405429:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788568748.405433:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788568748.406321:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006839d0bc/0x41e82f464b6a1c7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568748.406334:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006839d0bc/0x41e82f464b6a1c7b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568748.406378:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788568748.406420:0:8111:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006839d0bc/0x41e82f464b6a1c7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.406430:0:8111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006839d0bc/0x41e82f464b6a1c7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.406441:0:8111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006839d0bc/0x41e82f464b6a1c7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.406449:0:8111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006839d0bc/0x41e82f464b6a1c7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.406472:0:8111:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788568748.406524:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cd86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+12:2363:x1875449958463360:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 1159us (2066us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568748.406532:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 83 00000100:00100000:2.0:1788568748.407051:0:8111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3309:x1875449976273664:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11051us (11404us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1788568748.407060:0:8111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:0.0:1788568748.407150:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788568748.407158:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006839d0bc/0x41e82f464b6a1c7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.407174:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429df400 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788568748.407178:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006839d0bc/0x41e82f464b6a1c7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.407189:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006839d0bc/0x41e82f464b6a1c7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.407205:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006839d0bc/0x41e82f464b6a1c7b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.407213:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006839d0bc/0x41e82f464b6a1c7b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.407232:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568748.407234:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568748.407236:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788568748.407857:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ae2739f1180/2, rc 0, transno 4294967322 00000100:00100000:1.0:1788568748.407866:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976273664:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788568748.411376:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568748.411507:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958463488 00000100:00100000:2.0:1788568748.411517:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958463488 00000100:00100000:2.0:1788568748.411573:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 68 00000100:00100000:2.0:1788568748.411583:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+12:2363:x1875449958463488:12345-192.168.206.4@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788568748.437372:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:3.0:1788568748.437390:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:3.0:1788568748.437396:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:3.0:1788568748.437405:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:2.0:1788568748.437548:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+7:2363:x1875449958463488:12345-192.168.206.4@tcp:16:lhsmtool_posix.0 Request processed in 25961us (26176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568748.437560:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 68 00000100:00100000:3.0:1788568748.440276:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568748.440688:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958463744 00000100:00100000:0.0:1788568748.440698:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958463744 00000100:00100000:0.0:1788568748.440792:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 228 00000100:00100000:0.0:1788568748.440802:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273983800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+20:11625:x1875449958463744:12345-192.168.206.4@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788568748.440862:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568748.440886:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7be00/0x41e82f464b6a1c66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee44 expref: 20 pid: 12276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.440923:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ae255fb9600) 00010000:00010000:0.0:1788568748.440964:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788568748.440995:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1c89 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.441007:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1c89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.441017:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1c89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788568748.441266:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2b4c95e reply state 000000000314cb64 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1c89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568748.441276:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788568748.441367:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273983800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+21:11625:x1875449958463744:12345-192.168.206.4@tcp:36:lhsmtool_posix.0 Request processed in 566us (1099us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1788568748.441374:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 228 00000100:00100000:3.0:1788568748.444708:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00010000:00010000:2.0:1788568748.445490:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1c89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.445517:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1c89 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.445524:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1c89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.445529:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaa400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568748.445534:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1c89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.445541:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1c89 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.445557:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ae255fb9600) 00010000:00010000:2.0:1788568748.445560:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788568748.445564:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1c89 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.445571:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1c89 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568748.445604:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958463872 00000100:00100000:2.0:1788568748.445613:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958463872 00000100:00100000:2.0:1788568748.445659:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 69 00000100:00100000:2.0:1788568748.445668:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+7:2364:x1875449958463872:12345-192.168.206.4@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788568748.445899:0:6688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788568748.445904:0:6688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788568747 -> 1788568746 00002000:00010000:2.0:1788568748.445906:0:6688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788568745 00002000:00010000:2.0:1788568748.445908:0:6688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788568747 -> 1788568746 00002000:00010000:2.0:1788568748.445916:0:6688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788568748.445987:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+8:2364:x1875449958463872:12345-192.168.206.4@tcp:2:lhsmtool_posix.0 Request processed in 319us (1287us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1788568748.445995:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 69 00000100:00100000:3.0:1788568748.448254:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568748.448880:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958464128 00000100:00100000:1.0:1788568748.448890:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958464128 00000100:00100000:1.0:1788568748.448969:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 229 00000100:00100000:1.0:1788568748.448979:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273982d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+20:11625:x1875449958464128:12345-192.168.206.4@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788568748.449115:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1c90 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568748.449131:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1c4a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee36 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568748.449139:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1c90 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568748.449173:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1c4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee36 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568748.449205:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1c4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee36 expref: 20 pid: 5843 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568748.449221:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae277d95f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875449976274176:192.168.206.4@tcp:104: 00000100:00100000:1.0:1788568748.449298:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2503d5900 going to sleep for 11 seconds 00000100:00100000:1.0:1788568748.452507:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568748.452570:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958464256 00000100:00100000:3.0:1788568748.452579:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958464256 00010000:00010000:3.0:1788568748.452618:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1c4a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee36 expref: 21 pid: 5843 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568748.452654:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 84 00000100:00100000:3.0:1788568748.452678:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277d95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+21:2364:x1875449958464256:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788568748.452692:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568748.452700:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1c4a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee36 expref: 21 pid: 5843 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568748.452713:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1c4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee36 expref: 21 pid: 5843 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568748.452735:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ae255fb9600) 00010000:00010000:3.0:1788568748.452741:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1c90 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568748.452750:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1c90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568748.452758:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1c90 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568748.452776:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788568748.452824:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277d95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+21:2364:x1875449958464256:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 148us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568748.452831:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 84 00010000:00010000:0.0:1788568748.452915:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7a200/0x41e82f464b6a1c4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee36 expref: 20 pid: 5843 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568748.452967:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae277d95f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875449976274176:192.168.206.4@tcp:104: 00010000:00010000:0.0:1788568748.452996:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1c90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.453005:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1c90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.453011:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1c90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.453049:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1c90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.453057:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1c90 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.453063:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1c90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.453069:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2ca00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568748.453074:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1c90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.453094:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1c90 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.453104:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ae255fb9600) 00010000:00010000:0.0:1788568748.453107:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788568748.453110:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1c90 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.453117:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1c90 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568748.453166:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273982d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+19:11625:x1875449958464128:12345-192.168.206.4@tcp:55:lhsmtool_posix.0 Request processed in 4189us (4924us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788568748.453175:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 229 00000100:00100000:1.0:1788568748.455900:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568748.456336:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958464384 00000100:00100000:0.0:1788568748.456346:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958464384 00000100:00100000:0.0:1788568748.456404:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 70 00000100:00100000:0.0:1788568748.456426:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+8:2364:x1875449958464384:12345-192.168.206.4@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788568748.456468:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b8e47797/0x41e82f464b6a1c97 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.456487:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007dbf13f1/0x41e82f464b6a1c74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee52 expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.456496:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788568748.456500:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788568748.456505:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8e47797/0x41e82f464b6a1c97 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.456537:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007dbf13f1/0x41e82f464b6a1c74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee52 expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.456551:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007dbf13f1/0x41e82f464b6a1c74 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee52 expref: 8 pid: 6688 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568748.456566:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26f93ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6691:1875449976274304:192.168.206.4@tcp:104: 00000100:00100000:0.0:1788568748.456637:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae244836180 going to sleep for 11 seconds 00000100:00100000:1.0:1788568748.459690:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568748.459771:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958464512 00000100:00100000:3.0:1788568748.459781:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958464512 00010000:00010000:3.0:1788568748.459820:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007dbf13f1/0x41e82f464b6a1c74 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee52 expref: 9 pid: 6688 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568748.459860:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 85 00000100:00100000:3.0:1788568748.459869:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+9:2364:x1875449958464512:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788568748.459896:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568748.459916:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007dbf13f1/0x41e82f464b6a1c74 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee52 expref: 9 pid: 6688 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568748.459957:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007dbf13f1/0x41e82f464b6a1c74 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee52 expref: 9 pid: 6688 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568748.459979:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788568748.459984:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788568748.459990:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b8e47797/0x41e82f464b6a1c97 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568748.460000:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8e47797/0x41e82f464b6a1c97 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568748.460019:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788568748.460075:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+9:2364:x1875449958464512:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 206us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568748.460095:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 85 00010000:00010000:0.0:1788568748.460315:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007dbf13f1/0x41e82f464b6a1c74 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee52 expref: 8 pid: 6688 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568748.460331:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26f93ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6691:1875449976274304:192.168.206.4@tcp:104: 00010000:00010000:0.0:1788568748.460350:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b8e47797/0x41e82f464b6a1c97 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.460372:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b8e47797/0x41e82f464b6a1c97 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.460380:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8e47797/0x41e82f464b6a1c97 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.460403:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b8e47797/0x41e82f464b6a1c97 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.460410:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8e47797/0x41e82f464b6a1c97 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.460417:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8e47797/0x41e82f464b6a1c97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.460424:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feabe00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788568748.460427:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8e47797/0x41e82f464b6a1c97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.460436:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8e47797/0x41e82f464b6a1c97 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.460448:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8e47797/0x41e82f464b6a1c97 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.460465:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8e47797/0x41e82f464b6a1c97 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568748.460509:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+7:2364:x1875449958464384:12345-192.168.206.4@tcp:1:lhsmtool_posix.0 Request processed in 4085us (4618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568748.460517:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 70 00000100:00100000:1.0:1788568748.462977:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568748.463097:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958464768 00000100:00100000:3.0:1788568748.463107:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958464768 00000100:00100000:3.0:1788568748.463377:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 230 00000100:00100000:3.0:1788568748.463389:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+19:11625:x1875449958464768:12345-192.168.206.4@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788568748.463458:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1c9e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568748.463475:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1c9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568748.463500:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1c9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568748.463687:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1ca5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568748.463700:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1c58 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee3d expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568748.463708:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1ca5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568748.463740:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1c58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee3d expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568748.463756:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1c58 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee3d expref: 20 pid: 5842 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568748.463769:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273980a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1875449976274432:192.168.206.4@tcp:104: 00000100:00100000:3.0:1788568748.463849:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae242acb0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788568748.467910:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568748.468025:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958464896 00000100:00100000:2.0:1788568748.468034:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958464896 00010000:00010000:2.0:1788568748.468090:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1c58 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee3d expref: 21 pid: 5842 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568748.468136:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 86 00000100:00100000:2.0:1788568748.468146:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+21:2363:x1875449958464896:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788568748.468159:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568748.468166:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1c58 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee3d expref: 21 pid: 5842 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.468179:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1c58 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee3d expref: 21 pid: 5842 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.468198:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ae255fb9600) 00010000:00010000:2.0:1788568748.468204:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1ca5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.468213:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1ca5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.468220:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1ca5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.468238:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568748.468296:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+21:2363:x1875449958464896:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 152us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568748.468304:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 86 00010000:00010000:3.0:1788568748.468658:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1c58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee3d expref: 20 pid: 5842 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568748.468674:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273980a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1875449976274432:192.168.206.4@tcp:104: 00010000:00010000:3.0:1788568748.468694:0:6714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1ca5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568748.468703:0:6714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1ca5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568748.468716:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1ca5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788568748.468886:0:6714:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1788568748.469758:0:6714:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1788568748.469812:0:6714:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1788568748.469895:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273980a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6714:1875449976274560:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788568748.470000:0:6714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568748.470304:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae242acb0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788568748.470906:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976274560 00000100:00100000:1.0:1788568748.470915:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976274560 00000100:00100000:1.0:1788568748.471249:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788568748.471260:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273980380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6714:x1875449976274560:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788568748.471366:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273980380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6714:x1875449976274560:12345-0@lo:1000:mdt00_003.0 Request processed in 108us (1365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568748.471373:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788568748.471435:0:6714:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:0.0:1788568748.471441:0:6714:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:0.0:1788568748.471458:0:6714:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ae2739f1500, transno 4294967321 00000004:00080000:0.0:1788568748.471469:0:6714:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ae2739f1180, transno 4294967322 00000100:00100000:0.0:1788568748.471475:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273980a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6714:1875449976274560:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1788568748.471964:0:6714:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1788568748.472047:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26f93ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6714:1875449976274688:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788568748.472108:0:6714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568748.472437:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2448363c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788568748.472467:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976274688 00000100:00100000:2.0:1788568748.472473:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976274688 00000100:00100000:2.0:1788568748.472501:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788568748.472508:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6714:x1875449976274688:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788568748.472712:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6714:x1875449976274688:12345-0@lo:1000:mdt00_003.0 Request processed in 204us (603us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1788568748.472719:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788568748.473331:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26f93ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6714:1875449976274688:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788568748.473365:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1ca5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.473374:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1ca5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.473382:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1ca5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.473388:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429df200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568748.473400:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1ca5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.473408:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1ca5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.473422:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ae255fb9600) 00010000:00010000:0.0:1788568748.473425:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788568748.473430:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1ca5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.473437:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df200/0x41e82f464b6a1ca5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.473465:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1be8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.473472:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1be8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.473478:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1be8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.473483:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7ae00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568748.473486:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1be8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.473493:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1be8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.473501:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ae25820c300) 00010000:00010000:0.0:1788568748.473503:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788568748.473517:0:6714:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1bef lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee21 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.473529:0:6714:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1bef lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee21 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.473538:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1bef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee21 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.473568:0:6714:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1bef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee21 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568748.473581:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bf60000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1875449976274816:192.168.206.4@tcp:105: 00000100:00100000:0.0:1788568748.473642:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2448363c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788568748.477763:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bf60000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1875449976274816:192.168.206.4@tcp:105: 00010000:00010000:0.0:1788568748.477793:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1be8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.477802:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7ae00/0x41e82f464b6a1be8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.477845:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a1cac lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.477859:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a1cac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.477870:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a1cac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.477897:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a1cac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.477903:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a1cac lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.477909:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a1cac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.477914:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feabe00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568748.477918:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a1cac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.477959:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a1cac lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.477973:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ae25820c300) 00010000:00010000:0.0:1788568748.477976:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788568748.477980:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a1cac lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.477986:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a1cac lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.477995:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1c9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.478001:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1c9e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.478007:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1c9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.478020:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429de600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568748.478022:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1c9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.478037:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1c9e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.478046:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ae25820c300) 00010000:00010000:0.0:1788568748.478048:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788568748.478051:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1c9e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.478056:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de600/0x41e82f464b6a1c9e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568748.478295:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+23:11625:x1875449958464768:12345-192.168.206.4@tcp:57:lhsmtool_posix.0 Request processed in 14907us (15365us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1788568748.478306:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 230 00000020:00080000:0.0:1788568748.478311:0:6714:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788568748.478542:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788568748.478546:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788568748.479074:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788568748.479095:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788568748.480992:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568748.481158:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958465024 00000100:00100000:0.0:1788568748.481167:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958465024 00000100:00100000:0.0:1788568748.481209:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 61 00000100:00100000:0.0:1788568748.481219:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+23:11623:x1875449958465024:12345-192.168.206.4@tcp:49:lfs.0 00000100:00100000:0.0:1788568748.481344:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+23:11623:x1875449958465024:12345-192.168.206.4@tcp:49:lfs.0 Request processed in 125us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568748.481351:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 61 00000100:00100000:2.0:1788568748.484603:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568748.487942:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958465280 00000100:00100000:0.0:1788568748.487957:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958465280 00000100:00100000:0.0:1788568748.488038:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 62 00000100:00100000:0.0:1788568748.488048:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24926c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+23:11625:x1875449958465280:12345-192.168.206.4@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788568748.488659:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788568748.488758:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1788568748.488799:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1cb3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.488832:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1cb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.488845:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1cb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.488855:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1cb3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.488861:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1cb3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.488868:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1cb3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.488897:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788568748.489018:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24926c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+25:11625:x1875449958465280:12345-192.168.206.4@tcp:35:lhsmtool_posix.0 Request processed in 969us (4425us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1788568748.489027:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 62 00000020:00080000:0.0:1788568748.489032:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788568748.490858:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788568748.490870:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1cb3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.490880:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaa800 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:2.0:1788568748.490884:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1cb3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.490894:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1cb3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.490910:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ae24515a500) 00010000:00010000:2.0:1788568748.490913:0:8455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788568748.490917:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1cb3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.490923:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1cb3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568748.491006:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568748.491008:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568748.491009:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568748.492338:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568748.492418:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958465536 00000100:00100000:0.0:1788568748.492427:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958465536 00000100:00100000:0.0:1788568748.492506:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 231 00000100:00100000:0.0:1788568748.492516:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+25:11623:x1875449958465536:12345-192.168.206.4@tcp:58:lfs.0 00000040:00080000:0.0:1788568748.492749:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1788568748.492857:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+25:11623:x1875449958465536:12345-192.168.206.4@tcp:58:lfs.0 Request processed in 342us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568748.492865:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 231 00000100:00100000:3.0:1788568748.535994:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925db6b8-84bc-418c-b37a-40345c1020be:3307:1875449976274944:0@lo:400:kworker.0 00000100:00100000:3.0:1788568748.536064:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568748.536239:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976274944 00000100:00100000:1.0:1788568748.536249:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976274944 00000100:00100000:1.0:1788568748.536297:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1788568748.536306:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+19:3307:x1875449976274944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568748.536583:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875449976275200:0@lo:400:kworker.0 00000100:00100000:0.0:1788568748.536615:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568748.536642:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788568748.536647:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875449976275072:0@lo:400:kworker.0 00000100:00100000:0.0:1788568748.536668:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568748.536690:0:12276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976275200 00000100:00100000:0.0:1788568748.536694:0:12276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976275200 00000100:00100000:0.0:1788568748.536729:0:12276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976275072 00000100:00100000:0.0:1788568748.536732:0:12276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976275072 00000100:00100000:0.0:1788568748.536767:0:12276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788568748.536773:0:12276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875449976275200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568748.536810:0:12276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875449976275200:12345-0@lo:400:kworker.0 Request processed in 36us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568748.536817:0:12276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788568748.536833:0:12276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788568748.536839:0:12276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27fec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875449976275072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568748.536865:0:12276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27fec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875449976275072:12345-0@lo:400:kworker.0 Request processed in 27us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568748.536871:0:12276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788568748.536903:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875449976275072:0@lo:400:kworker.0 00000100:00100000:0.0:1788568748.536913:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875449976275200:0@lo:400:kworker.0 00000100:00100000:2.0:1788568748.538745:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875449976275328:0@lo:400:kworker.0 00000100:00100000:1.0:1788568748.538745:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+19:3307:x1875449976274944:12345-0@lo:400:kworker.0 Request processed in 2435us (2676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568748.538767:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1788568748.538795:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568748.538955:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976275328 00000100:00100000:0.0:1788568748.538962:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976275328 00000100:00100000:0.0:1788568748.539002:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788568748.539462:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875449976275328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568748.539526:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875449976275328:12345-0@lo:400:kworker.0 Request processed in 517us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568748.539534:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788568748.539674:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875449976275328:0@lo:400:kworker.0 00000100:00100000:3.0:1788568748.539807:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925db6b8-84bc-418c-b37a-40345c1020be:3307:1875449976274944:0@lo:400:kworker.0 00000100:00080000:2.0:1788568748.542519:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788568748.556067:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568748.556212:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958465664 00000100:00100000:1.0:1788568748.556221:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958465664 00000100:00100000:1.0:1788568748.556277:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 232 00000100:00100000:1.0:1788568748.556287:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+25:11627:x1875449958465664:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:1.0:1788568748.556309:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568748.556327:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2cc00/0x41e82f464b6a1cba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bee59 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568748.556385:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a1cc1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568748.556398:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a1cc1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568748.556410:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a1cc1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568748.556425:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a1cc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568748.556431:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a1cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568748.556437:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a1cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568748.556642:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1ccf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568748.556661:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1bda lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee1a expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568748.556670:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1ccf lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568748.557128:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1bda lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee1a expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568748.557147:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1bda lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee1a expref: 26 pid: 5843 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568748.557160:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2526d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1875449976275456:192.168.206.4@tcp:104: 00000100:00100000:1.0:1788568748.557239:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2503d5540 going to sleep for 11 seconds 00000100:00100000:2.0:1788568748.561459:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2526d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1875449976275456:192.168.206.4@tcp:104: 00010000:00010000:2.0:1788568748.561497:0:6714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1ccf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568748.562908:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568748.563017:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958465920 00000100:00100000:0.0:1788568748.563026:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958465920 00000100:00100000:0.0:1788568748.563071:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 63 00000100:00100000:0.0:1788568748.563112:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+27:5599:x1875449958465920:12345-192.168.206.4@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788568748.563324:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+28:5599:x1875449958465920:12345-192.168.206.4@tcp:35:ldlm_bl.0 Request processed in 244us (421us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1788568748.563332:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 63 00000100:00100000:3.0:1788568748.569264:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568748.569528:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958466048 00000100:00100000:0.0:1788568748.569538:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958466048 00010000:00010000:0.0:1788568748.569576:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1bda lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee1a expref: 28 pid: 5843 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568748.569616:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 87 00000100:00100000:0.0:1788568748.569626:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273983100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+28:2363:x1875449958466048:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788568748.569638:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568748.569645:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1bda lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee1a expref: 28 pid: 5843 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.569658:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1bda lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee1a expref: 28 pid: 5843 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.569692:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d200/0x41e82f464b6a1bda lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee1a expref: 28 pid: 5843 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.569707:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ae25820c300) 00010000:00010000:0.0:1788568748.569712:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1ccf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.569721:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1ccf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.569728:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1ccf lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568748.569771:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788568748.569831:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273983100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+27:2363:x1875449958466048:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 206us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568748.569838:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 87 00010000:00010000:3.0:1788568748.569900:0:6714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1ccf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568748.569908:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1ccf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788568748.569979:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788568748.569984:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788568748.570004:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1ccf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568748.570017:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1ccf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568748.570026:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a1cc1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568748.570042:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a1cc1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568748.570048:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a1cc1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568748.570053:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2d000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568748.570058:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a1cc1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568748.570065:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a1cc1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568748.570075:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ae2430ad300) 00010000:00010000:3.0:1788568748.570089:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788568748.570093:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a1cc1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568748.570099:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a1cc1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568748.570108:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a1cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568748.570114:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a1cc8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568748.570120:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a1cc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568748.570125:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2c600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568748.570134:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a1cc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568748.570141:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a1cc8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568748.570153:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ae25d03e700) 00010000:00010000:3.0:1788568748.570156:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788568748.570159:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a1cc8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568748.570164:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a1cc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568748.570198:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2cc00/0x41e82f464b6a1cba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee59 expref: 27 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568748.570212:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1ccf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee59 expref: 26 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568748.570219:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ae25820c300) 00010000:00010000:3.0:1788568748.570222:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788568748.570224:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2d600, rc 0) 00000100:00100000:3.0:1788568748.570250:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+26:11627:x1875449958465664:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 13965us (14193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568748.570258:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 232 00000001:00080000:0.0:1788568748.571160:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:0.0:1788568748.571180:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:0.0:1788568748.571190:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000100:00100000:0.0:1788568749.048098:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976275584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788568749.048164:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568749.048265:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976275584 00000100:00100000:2.0:1788568749.048272:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976275584 00000100:00100000:2.0:1788568749.048321:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788568749.048330:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bf05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976275584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788568749.048361:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788568749.048407:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bf05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976275584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568749.048413:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788568749.048447:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1788568749.048453:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ae141c32a00, transno 4294967307 00000004:00080000:2.0:1788568749.048463:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1788568749.048478:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ae27cd87480, transno 4294967310 00000100:00100000:2.0:1788568749.048488:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976275584:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788568749.240596:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788568749.264701:0:12574:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788568749.264716:0:12574:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788568749.264777:0:12574:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788568749.264784:0:12574:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788568749.496147:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788568749.496155:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788568749.496188:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788568749.496195:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788568749.496309:0:11686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2526d6d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11686:1875449976275712:192.168.206.4@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788568749.496422:0:11686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2503d53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788568749.501415:0:11686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2526d6d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11686:1875449976275712:192.168.206.4@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788568749.502116:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568749.502669:0:12276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958466176 00000100:00100000:0.0:1788568749.502678:0:12276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958466176 00000100:00100000:0.0:1788568749.502773:0:12276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 233 00000100:00100000:0.0:1788568749.502783:0:12276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27f83c0c-e36b-48ce-9485-80051fd252dc+26:11640:x1875449958466176:12345-192.168.206.4@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788568749.502824:0:12276:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788568749.502987:0:12276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27f83c0c-e36b-48ce-9485-80051fd252dc+26:11640:x1875449958466176:12345-192.168.206.4@tcp:53:lhsmtool_posix.0 Request processed in 204us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568749.502994:0:12276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 233 00000100:00100000:3.0:1788568749.507354:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568749.507729:0:12276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958466432 00000100:00100000:0.0:1788568749.507738:0:12276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958466432 00000100:00100000:0.0:1788568749.507799:0:12276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 234 00000100:00100000:0.0:1788568749.507809:0:12276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27f83c0c-e36b-48ce-9485-80051fd252dc+26:11640:x1875449958466432:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788568749.507828:0:12276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568749.507848:0:12276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1cd6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bee60 expref: -99 pid: 12276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568749.507958:0:12276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a1cdd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568749.507974:0:12276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a1cdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568749.507986:0:12276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a1cdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788568749.507996:0:12276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788568749.508129:0:12276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1cd6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee60 expref: 29 pid: 12276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568749.508153:0:12276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a1cdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee60 expref: 28 pid: 12276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568749.508162:0:12276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ae25820c300) 00010000:00010000:0.0:1788568749.508165:0:12276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788568749.508180:0:12276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae27feabe00, rc 0) 00000100:00100000:0.0:1788568749.508238:0:12276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27f83c0c-e36b-48ce-9485-80051fd252dc+28:11640:x1875449958466432:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 430us (893us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1788568749.508245:0:12276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 234 00000100:00100000:3.0:1788568749.511608:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568749.511871:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568749.512165:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958466816 00000100:00100000:0.0:1788568749.512175:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958466816 00000100:00100000:0.0:1788568749.512232:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 235 00000100:00100000:0.0:1788568749.512243:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273983480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+28:11640:x1875449958466816:12345-192.168.206.4@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788568749.512288:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958466560 00000100:00100000:2.0:1788568749.512293:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958466560 00010000:00010000:0.0:1788568749.512317:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1ceb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568749.512328:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 16 00010000:00010000:0.0:1788568749.512333:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1ceb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568749.512335:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25319d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+29:2364:x1875449958466560:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788568749.512345:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1ceb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568749.512346:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568749.512361:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feabe00/0x41e82f464b6a1cdd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee60 expref: 29 pid: 12276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568749.512376:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ae25820c300) 00010000:00010000:2.0:1788568749.512381:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568749.512431:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25319d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+28:2364:x1875449958466560:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 96us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568749.512437:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 16 00010000:00010000:0.0:1788568749.512517:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1ceb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568749.512525:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1ceb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568749.512531:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1ceb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568749.512537:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaa800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568749.512541:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1ceb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568749.512548:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1ceb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568749.512566:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ae25820c300) 00010000:00010000:0.0:1788568749.512568:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788568749.512572:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1ceb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568749.512578:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa800/0x41e82f464b6a1ceb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568749.514152:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273983480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+28:11640:x1875449958466816:12345-192.168.206.4@tcp:57:lhsmtool_posix.0 Request processed in 1902us (2272us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1788568749.514165:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 235 00000040:00080000:2.0:1788568749.514318:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788568749.514323:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788568749.515424:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788568749.515436:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788568749.520063:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568749.520463:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958467072 00000100:00100000:0.0:1788568749.520471:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958467072 00000100:00100000:0.0:1788568749.520520:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 64 00000100:00100000:0.0:1788568749.520530:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273980e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+28:11640:x1875449958467072:12345-192.168.206.4@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788568749.520738:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273980e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+29:11640:x1875449958467072:12345-192.168.206.4@tcp:35:lhsmtool_posix.0 Request processed in 208us (683us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1788568749.520745:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 64 00000100:00100000:1.0:1788568749.559283:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788568749.559306:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae141c32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976275840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788568749.559384:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568749.559510:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976275840 00000100:00100000:3.0:1788568749.559518:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976275840 00000100:00100000:3.0:1788568749.559564:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788568749.559574:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875449976275840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788568749.559595:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1788568749.559641:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875449976275840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568749.559648:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788568749.559743:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae141c32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976275840:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788568750.266229:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788568751.103447:0:12625:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788568751.103455:0:12625:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788568751.103502:0:12625:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788568751.103508:0:12625:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788568751.291484:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568751.316998:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568751.317595:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958467328 00000100:00100000:3.0:1788568751.317606:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958467328 00000100:00100000:3.0:1788568751.317666:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 236 00000100:00100000:3.0:1788568751.317676:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+29:11660:x1875449958467328:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:3.0:1788568751.317696:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568751.317714:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1cf2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bee67 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568751.317814:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1cf9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568751.317829:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1cf9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568751.317842:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1cf9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788568751.317864:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788568751.317992:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dea00/0x41e82f464b6a1cf2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee67 expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568751.318020:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1cf9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee67 expref: 31 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568751.318029:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ae25820c300) 00010000:00010000:3.0:1788568751.318032:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788568751.318036:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429de800, rc 0) 00000100:00100000:3.0:1788568751.318100:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+31:11660:x1875449958467328:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 425us (1107us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788568751.318107:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 236 00000100:00080000:2.0:1788568751.318511:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788568751.342170:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568751.342401:0:12276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958467456 00000100:00100000:0.0:1788568751.342410:0:12276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958467456 00000100:00100000:0.0:1788568751.342457:0:12276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 237 00000100:00100000:0.0:1788568751.342467:0:12276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273983100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27f83c0c-e36b-48ce-9485-80051fd252dc+31:11660:x1875449958467456:12345-192.168.206.4@tcp:54:lfs.0 00010000:00010000:0.0:1788568751.342525:0:12276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1d07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568751.342541:0:12276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1d07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568751.342553:0:12276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1d07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568751.342589:0:12276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1d07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568751.342597:0:12276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1d07 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568751.342605:0:12276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1d07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568751.342611:0:12276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaa400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568751.342616:0:12276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1d07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568751.342624:0:12276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1d07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568751.342636:0:12276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ae25820c300) 00010000:00010000:0.0:1788568751.342639:0:12276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788568751.342643:0:12276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1d07 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568751.342650:0:12276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feaa400/0x41e82f464b6a1d07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568751.342714:0:12276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273983100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27f83c0c-e36b-48ce-9485-80051fd252dc+31:11660:x1875449958467456:12345-192.168.206.4@tcp:54:lfs.0 Request processed in 248us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568751.342722:0:12276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 237 00000100:00100000:0.0:1788568751.456630:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568751.456701:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958467584 00000100:00100000:2.0:1788568751.456710:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958467584 00000100:00100000:2.0:1788568751.456812:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 71 00000100:00100000:2.0:1788568751.456822:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+7:2362:x1875449958467584:12345-192.168.206.4@tcp:101:cat.0 00010000:00010000:2.0:1788568751.456836:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568751.456861:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d05415af/0x41e82f464b6a1d0e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bee6e expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788568751.456898:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9b64aa, atime: 0x6a9b64a9, ctime: 0x6a9b64aa, blocks: 0xb 00010000:00010000:2.0:1788568751.456917:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=385s v=(0 0) 00010000:00010000:2.0:1788568751.456922:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788568751.456976:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d05415af/0x41e82f464b6a1d0e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee6e expref: 8 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568751.456994:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d05415af/0x41e82f464b6a1d0e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee6e expref: 8 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568751.457006:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7b600, rc 0) 00000100:00100000:2.0:1788568751.457059:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+8:2362:x1875449958467584:12345-192.168.206.4@tcp:101:cat.0 Request processed in 239us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568751.457075:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 71 00000100:00080000:0.0:1788568751.459318:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788568751.461523:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568751.461651:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958467712 00000100:00100000:2.0:1788568751.461661:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958467712 00002000:00100000:2.0:1788568751.461707:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9ae141c32a00 x1875449958467712/t0(0) o3->27f83c0c-e36b-48ce-9485-80051fd252dc@192.168.206.4@tcp:187/0 lens 488/0 e 0 to 0 dl 1788568762 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788568751.461718:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae141c32a00 with x1875449958467712 ext(0->4095) 00002000:00010000:2.0:1788568751.461722:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ae141c32a00 00000100:00100000:2.0:1788568751.461787:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 7 00000100:00100000:2.0:1788568751.461797:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae141c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+8:2361:x1875449958467712:12345-192.168.206.4@tcp:3:cat.0 00000100:00100000:2.0:1788568751.462052:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae141c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+8:2361:x1875449958467712:12345-192.168.206.4@tcp:3:cat.0 Request processed in 255us (536us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788568751.462081:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 7 00002000:00100000:2.0:1788568751.462088:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9ae141c32a00 x1875449958467712/t0(0) o3->27f83c0c-e36b-48ce-9485-80051fd252dc@192.168.206.4@tcp:187/0 lens 488/4536 e 0 to 0 dl 1788568762 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788568751.462097:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae141c32a00 with x1875449958467712 ext(0->4095) 00002000:00010000:2.0:1788568751.462100:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ae141c32a00 00000100:00100000:3.0:1788568751.634400:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568751.634515:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568751.634557:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568751.637544:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958467968 00000100:00100000:1.0:1788568751.637559:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958467968 00000100:00100000:1.0:1788568751.637663:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 96 00000100:00100000:1.0:1788568751.637676:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273980a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2363:x1875449958467968:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:1.0:1788568751.637752:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273980a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2363:x1875449958467968:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 79us (3193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568751.637759:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 96 00000100:00100000:2.0:1788568751.638448:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958468096 00000100:00100000:2.0:1788568751.638454:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958468096 00000100:00100000:2.0:1788568751.638506:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 164 00000100:00100000:2.0:1788568751.638515:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2363:x1875449958468096:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:2.0:1788568751.638560:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2363:x1875449958468096:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 46us (4045us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568751.638567:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 164 00000100:00100000:0.0:1788568751.640056:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958467840 00000100:00100000:0.0:1788568751.640079:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958467840 00000100:00100000:0.0:1788568751.640173:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 299 00000100:00080000:3.0:1788568751.640175:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788568751.640181:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788568751.640183:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+13:2363:x1875449958467840:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:0.0:1788568751.640250:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+13:2363:x1875449958467840:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 68us (5859us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568751.640257:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 299 00010000:00010000:2.0:1788568752.312205:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788568752.568172:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788568752.568180:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788568752.568210:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788568752.568216:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788568753.336159:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568753.656049:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bcbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976276352:0@lo:400:kworker.0 00000100:00100000:0.0:1788568753.656125:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568753.656180:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788568753.656186:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae281709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:925db6b8-84bc-418c-b37a-40345c1020be:3308:1875449976275968:0@lo:400:kworker.0 00000100:00100000:0.0:1788568753.656215:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568753.656248:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bcbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875449976276480:0@lo:400:kworker.0 00000100:00100000:0.0:1788568753.656271:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568753.656298:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae281709180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976276096:0@lo:400:kworker.0 00000100:00100000:0.0:1788568753.656322:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568753.656338:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27bcbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976276608:0@lo:400:kworker.0 00000100:00100000:0.0:1788568753.656358:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568753.656373:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788568753.656379:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae281709c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875449976276224:0@lo:400:kworker.0 00000100:00100000:0.0:1788568753.656399:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568753.656430:0:8111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976276352 00000100:00100000:0.0:1788568753.656436:0:8111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976276352 00000100:00100000:0.0:1788568753.656483:0:8111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976276608 00000100:00100000:0.0:1788568753.656487:0:8111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976276608 00000100:00100000:0.0:1788568753.656509:0:8111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788568753.656530:0:8111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bcbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1875449976276352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568753.656579:0:8111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bcbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1875449976276352:12345-0@lo:400:kworker.0 Request processed in 51us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568753.656586:0:8111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788568753.656603:0:8111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788568753.656608:0:8111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fa21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976276608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568753.656639:0:8111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fa21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976276608:12345-0@lo:400:kworker.0 Request processed in 30us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568753.656644:0:8111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788568753.656662:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976276480 00000100:00100000:0.0:1788568753.656667:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976276480 00000100:00100000:0.0:1788568753.656688:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976276096 00000100:00100000:0.0:1788568753.656691:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976276096 00000100:00100000:0.0:1788568753.656703:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976276224 00000100:00100000:0.0:1788568753.656706:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976276224 00000100:00100000:0.0:1788568753.656718:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788568753.656724:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bcbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875449976276480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568753.656752:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bcbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875449976276480:12345-0@lo:400:kworker.0 Request processed in 29us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568753.656758:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788568753.656770:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788568753.656776:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fa22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976276096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568753.656818:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fa22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976276096:12345-0@lo:400:kworker.0 Request processed in 43us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568753.656824:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788568753.656835:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788568753.656841:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fa20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875449976276224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568753.656879:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fa20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875449976276224:12345-0@lo:400:kworker.0 Request processed in 38us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568753.656884:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:0.0:1788568753.656907:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788568753.656911:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788568753.656913:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788568753.656966:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae281709c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875449976276224:0@lo:400:kworker.0 00000100:00100000:0.0:1788568753.656977:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae281709180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976276096:0@lo:400:kworker.0 00000100:00100000:0.0:1788568753.656986:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bcbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976276608:0@lo:400:kworker.0 00000100:00100000:0.0:1788568753.657012:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bcbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875449976276480:0@lo:400:kworker.0 00000100:00100000:0.0:1788568753.657022:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27bcbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976276352:0@lo:400:kworker.0 00000100:00100000:1.0:1788568753.658509:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976275968 00000100:00100000:1.0:1788568753.658522:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976275968 00000100:00100000:1.0:1788568753.658562:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1788568753.658571:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+19:3308:x1875449976275968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568753.658645:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925db6b8-84bc-418c-b37a-40345c1020be+19:3308:x1875449976275968:12345-0@lo:400:kworker.0 Request processed in 75us (2428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568753.658651:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1788568753.658706:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae281709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:925db6b8-84bc-418c-b37a-40345c1020be:3308:1875449976275968:0@lo:400:kworker.0 00000001:00080000:3.0:1788568753.734676:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:3.0:1788568753.734689:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:3.0:1788568753.737047:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000020:00080000:3.0:1788568753.737081:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ae244836000 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1788568753.737086:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ae273b22000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ae244836180 00000020:00080000:3.0:1788568753.737090:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ae273b22500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ae26fb84000 00000020:00080000:3.0:1788568753.737117:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 5 00000020:00080000:3.0:1788568753.737385:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1788568753.737498:0:5865:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:1.0:1788568753.737511:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000100:00100000:1.0:1788568754.178066:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2526d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976276736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788568754.178133:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568754.178196:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976276736 00000100:00100000:3.0:1788568754.178206:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976276736 00000100:00100000:3.0:1788568754.178360:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788568754.178372:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976276736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788568754.178411:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788568754.178520:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976276736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568754.178527:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788568754.183815:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2526d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976276736:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788568754.359289:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568754.679614:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26fa20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976276864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788568754.679687:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568754.679765:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976276864 00000100:00100000:1.0:1788568754.679772:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976276864 00000100:00100000:1.0:1788568754.679834:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788568754.679843:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976276864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788568754.679881:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788568754.679957:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976276864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568754.679965:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788568754.680005:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1788568754.680011:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1788568754.680040:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26fa20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976276864:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788568755.387759:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568756.409031:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568756.769406:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568756.769449:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568756.769487:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568756.769520:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568756.769544:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568756.769626:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958468224 00000100:00100000:0.0:1788568756.769635:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958468224 00000100:00100000:0.0:1788568756.769687:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 301 00000100:00100000:0.0:1788568756.769707:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+13:2362:x1875449958468224:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:0.0:1788568756.769772:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f0f084e-5158-464d-a770-11379825208e+13:2362:x1875449958468224:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 77us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568756.769780:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 301 00000100:00100000:0.0:1788568756.769813:0:12276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958468736 00000100:00100000:0.0:1788568756.769817:0:12276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958468736 00000100:00100000:0.0:1788568756.769849:0:12276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958468352 00000100:00100000:0.0:1788568756.769852:0:12276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958468352 00000100:00100000:0.0:1788568756.769872:0:12276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 168 00000100:00100000:0.0:1788568756.769878:0:12276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2362:x1875449958468736:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:0.0:1788568756.769922:0:12276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2362:x1875449958468736:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 44us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568756.770582:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 169 00000100:00100000:2.0:1788568756.770596:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f93ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+18:2362:x1875449958468352:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:2.0:1788568756.770635:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f93ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27f83c0c-e36b-48ce-9485-80051fd252dc+18:2362:x1875449958468352:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 44us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568756.770641:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 169 00000100:00080000:2.0:1788568756.770684:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788568756.770824:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958468480 00000100:00100000:2.0:1788568756.770830:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958468480 00000100:00100000:2.0:1788568756.770864:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958468608 00000100:00100000:2.0:1788568756.770867:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958468608 00000100:00100000:2.0:1788568756.770886:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 99 00000100:00100000:2.0:1788568756.770893:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+7:2362:x1875449958468480:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:0.0:1788568756.771049:0:12276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 168 00000100:00100000:0.0:1788568756.771110:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 100 00000100:00100000:0.0:1788568756.771117:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2362:x1875449958468608:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:0.0:1788568756.771146:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2362:x1875449958468608:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 30us (1602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568756.771153:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 100 00000100:00080000:3.0:1788568756.771269:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788568756.771272:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788568756.771419:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+7:2362:x1875449958468480:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 35us (1478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568756.771427:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 99 00000100:00100000:2.0:1788568756.801737:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568756.802013:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958468864 00000100:00100000:1.0:1788568756.802026:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958468864 00000100:00100000:1.0:1788568756.802104:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 238 00000100:00100000:1.0:1788568756.802115:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+18:11304:x1875449958468864:12345-192.168.206.4@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788568756.802407:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+18:11304:x1875449958468864:12345-192.168.206.4@tcp:60:lhsmtool_posix.0 Request processed in 292us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568756.802416:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 238 00000100:00100000:1.0:1788568756.810332:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568756.810492:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958469120 00000100:00100000:2.0:1788568756.810505:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958469120 00000100:00100000:2.0:1788568756.810579:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 65 00000100:00100000:2.0:1788568756.810593:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+18:11304:x1875449958469120:12345-192.168.206.4@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788568756.811090:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+19:11304:x1875449958469120:12345-192.168.206.4@tcp:35:lhsmtool_posix.0 Request processed in 496us (772us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788568756.811100:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 65 00000100:00100000:0.0:1788568756.997918:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568756.998142:0:12276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958469248 00000100:00100000:1.0:1788568756.998156:0:12276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958469248 00000100:00100000:1.0:1788568756.998248:0:12276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 239 00000100:00100000:1.0:1788568756.998261:0:12276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fa21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:12112:x1875449958469248:12345-192.168.206.4@tcp:101:lsof.0 00010000:00010000:1.0:1788568756.998286:0:12276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568756.998311:0:12276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1d15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bee75 expref: -99 pid: 12276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568756.998392:0:12276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a1d1c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568756.998408:0:12276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a1d1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568756.998425:0:12276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a1d1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568756.998470:0:12276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788568756.998474:0:12276:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788568756.998503:0:12276:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a1d1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568756.998532:0:12276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ca00/0x41e82f464b6a1d15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee75 expref: 7 pid: 12276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568756.998555:0:12276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a1d1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee75 expref: 6 pid: 12276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568756.998565:0:12276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae2430ad100) 00010000:00010000:1.0:1788568756.998568:0:12276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788568756.998572:0:12276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2c400, rc 0) 00000100:00100000:1.0:1788568756.998659:0:12276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fa21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:be1fd6d4-5648-47eb-88cd-3d695851ff89+6:12112:x1875449958469248:12345-192.168.206.4@tcp:101:lsof.0 Request processed in 401us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568756.998673:0:12276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 239 00010000:00010000:3.0:1788568757.431390:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568758.455431:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568758.775375:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875449976277248:0@lo:400:kworker.0 00000100:00100000:3.0:1788568758.775438:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925db6b8-84bc-418c-b37a-40345c1020be:3309:1875449976276992:0@lo:400:kworker.0 00000100:00100000:2.0:1788568758.775480:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568758.775496:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568758.775562:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788568758.775568:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875449976277120:0@lo:400:kworker.0 00000100:00100000:2.0:1788568758.775592:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568758.775612:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976277632:0@lo:400:kworker.0 00000100:00100000:2.0:1788568758.775639:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568758.775683:0:8111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976277632 00000100:00100000:2.0:1788568758.775692:0:8111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976277632 00000100:00100000:2.0:1788568758.775775:0:8111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788568758.775785:0:8111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277d95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976277632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568758.775850:0:8111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277d95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976277632:12345-0@lo:400:kworker.0 Request processed in 66us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568758.775857:0:8111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:2.0:1788568758.775881:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788568758.775895:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976277248 00000100:00100000:2.0:1788568758.775899:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976277248 00000100:00100000:2.0:1788568758.775950:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976277120 00000100:00100000:2.0:1788568758.775953:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976277120 00000100:00100000:2.0:1788568758.775972:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788568758.775978:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875449976277248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568758.776011:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875449976277248:12345-0@lo:400:kworker.0 Request processed in 33us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568758.776017:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788568758.776039:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788568758.776046:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875449976277120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568758.776073:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875449976277120:12345-0@lo:400:kworker.0 Request processed in 28us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568758.776079:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:2.0:1788568758.776095:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788568758.776125:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875449976277120:0@lo:400:kworker.0 00000100:00100000:2.0:1788568758.776138:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976277632:0@lo:400:kworker.0 00000100:00100000:2.0:1788568758.776148:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875449976277248:0@lo:400:kworker.0 00000100:00100000:1.0:1788568758.776865:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976276992 00000100:00100000:1.0:1788568758.776876:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976276992 00000100:00100000:1.0:1788568758.776919:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1788568758.776958:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+19:3309:x1875449976276992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568758.777016:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+19:3309:x1875449976276992:12345-0@lo:400:kworker.0 Request processed in 90us (1521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568758.777022:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1788568758.777447:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976277376:0@lo:400:kworker.0 00000100:00100000:0.0:1788568758.777503:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568758.777557:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976277376 00000100:00100000:0.0:1788568758.777563:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976277376 00000100:00100000:0.0:1788568758.777605:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788568758.777613:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fa20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976277376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568758.777652:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fa20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976277376:12345-0@lo:400:kworker.0 Request processed in 41us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568758.777658:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:0.0:1788568758.777678:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788568758.777711:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976277376:0@lo:400:kworker.0 00000100:00100000:3.0:1788568758.784319:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925db6b8-84bc-418c-b37a-40345c1020be:3309:1875449976276992:0@lo:400:kworker.0 00000100:00100000:3.0:1788568758.784336:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875449976277504:0@lo:400:kworker.0 00000100:00100000:3.0:1788568758.784399:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568758.784642:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976277504 00000100:00100000:3.0:1788568758.784649:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976277504 00000100:00080000:0.0:1788568758.784710:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788568758.784730:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788568758.784742:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875449976277504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568758.784796:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875449976277504:12345-0@lo:400:kworker.0 Request processed in 57us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568758.784804:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788568758.784858:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875449976277504:0@lo:400:kworker.0 00000001:00080000:0.0:1788568758.856350:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1788568758.856375:0:5865:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1788568758.856464:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1788568758.856488:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:3.0:1788568759.289142:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788568759.289174:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976277760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788568759.289308:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568759.289677:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976277760 00000100:00100000:1.0:1788568759.289689:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976277760 00000100:00100000:1.0:1788568759.289773:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788568759.289786:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273b64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976277760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788568759.289835:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788568759.289904:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273b64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976277760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568759.289912:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788568759.291020:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976277760:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788568759.479315:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568759.799324:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788568759.799373:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae26fa20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976277888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788568759.799468:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568759.799622:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976277888 00000100:00100000:1.0:1788568759.799633:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976277888 00000100:00100000:1.0:1788568759.799697:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788568759.799709:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bcbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976277888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788568759.799757:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788568759.799809:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bcbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976277888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568759.799816:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788568759.800131:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae26fa20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976277888:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788568760.505875:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788568760.595545:0:12825:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 20:39:17 (1788568757) 00010000:00010000:0.0:1788568761.543108:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568761.877869:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568761.877920:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568761.877981:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568761.878005:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568761.878135:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568761.878165:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958469888 00000100:00100000:0.0:1788568761.878176:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958469888 00000100:00100000:0.0:1788568761.878234:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958469504 00000100:00100000:0.0:1788568761.878237:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958469504 00000100:00100000:3.0:1788568761.878485:0:8111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958469632 00000100:00100000:3.0:1788568761.878489:0:8111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958469632 00000100:00100000:3.0:1788568761.878522:0:8111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958469760 00000100:00100000:3.0:1788568761.878525:0:8111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958469760 00000100:00100000:3.0:1788568761.878550:0:8111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 103 00000100:00100000:3.0:1788568761.878560:0:8111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bcbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+7:2361:x1875449958469632:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:0.0:1788568761.878630:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 173 00000100:00100000:0.0:1788568761.878640:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27bcbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be1fd6d4-5648-47eb-88cd-3d695851ff89+6:2361:x1875449958469888:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:3.0:1788568761.879410:0:8111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bcbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+7:2361:x1875449958469632:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 847us (1484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568761.879421:0:8111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 103 00000100:00100000:3.0:1788568761.879445:0:8111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 104 00000100:00100000:3.0:1788568761.879453:0:8111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2361:x1875449958469760:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:1.0:1788568761.879524:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958469376 00000100:00100000:1.0:1788568761.879531:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958469376 00000100:00100000:1.0:1788568761.879564:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 303 00000100:00100000:1.0:1788568761.879570:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+13:2361:x1875449958469376:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:0.0:1788568761.885287:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27bcbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be1fd6d4-5648-47eb-88cd-3d695851ff89+6:2361:x1875449958469888:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 6637us (7293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568761.885309:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 173 00000100:00100000:0.0:1788568761.885352:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 174 00000100:00100000:0.0:1788568761.885366:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+18:2361:x1875449958469504:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:0.0:1788568761.885420:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+18:2361:x1875449958469504:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 60us (7414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568761.885427:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 174 00000100:00080000:0.0:1788568761.885459:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788568761.885464:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788568761.885467:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788568761.885761:0:8111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2361:x1875449958469760:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 6307us (7623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568761.885772:0:8111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 104 00000100:00100000:1.0:1788568761.885962:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+13:2361:x1875449958469376:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 6389us (8104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568761.885971:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 303 00010000:00010000:2.0:1788568762.556195:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788568762.807086:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788568762.807094:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788568762.807527:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1788568762.807533:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788568763.575277:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568763.895393:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925db6b8-84bc-418c-b37a-40345c1020be:3309:1875449976278016:0@lo:400:kworker.0 00000100:00100000:1.0:1788568763.895438:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976278144:0@lo:400:kworker.0 00000100:00100000:2.0:1788568763.895478:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568763.895484:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568763.895530:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875449976278528:0@lo:400:kworker.0 00000100:00100000:1.0:1788568763.895532:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976278656:0@lo:400:kworker.0 00000100:00100000:2.0:1788568763.895567:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568763.895585:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568763.895597:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788568763.895607:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976278400:0@lo:400:kworker.0 00000100:00100000:1.0:1788568763.895616:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788568763.895624:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875449976278272:0@lo:400:kworker.0 00000100:00100000:2.0:1788568763.895638:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568763.895659:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568763.895680:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976278656 00000100:00100000:2.0:1788568763.895688:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976278656 00000100:00100000:1.0:1788568763.895700:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976278400 00000100:00100000:1.0:1788568763.895706:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976278400 00000100:00100000:2.0:1788568763.895743:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788568763.895750:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788568763.895755:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976278656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568763.895763:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cd86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976278400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568763.895810:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976278656:12345-0@lo:400:kworker.0 Request processed in 59us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568763.895819:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788568763.895819:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cd86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976278400:12345-0@lo:400:kworker.0 Request processed in 59us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568763.895846:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788568763.897104:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976278656:0@lo:400:kworker.0 00000100:00100000:2.0:1788568763.897156:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976278400:0@lo:400:kworker.0 00000100:00100000:2.0:1788568763.897193:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976278144 00000100:00100000:2.0:1788568763.897198:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976278144 00000100:00100000:2.0:1788568763.897237:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976278528 00000100:00100000:2.0:1788568763.897240:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976278528 00000100:00100000:2.0:1788568763.897259:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976278272 00000100:00100000:2.0:1788568763.897262:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976278272 00000100:00100000:2.0:1788568763.897277:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788568763.897283:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976278144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568763.897345:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976278144:12345-0@lo:400:kworker.0 Request processed in 61us (1862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568763.897385:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788568763.897400:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788568763.897407:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875449976278528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568763.899054:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875449976278528:12345-0@lo:400:kworker.0 Request processed in 1642us (3482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568763.899065:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788568763.899090:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788568763.899098:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875449976278272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568763.899129:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875449976278272:12345-0@lo:400:kworker.0 Request processed in 33us (3470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568763.899134:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788568763.899179:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875449976278528:0@lo:400:kworker.0 00000100:00100000:2.0:1788568763.899213:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875449976278272:0@lo:400:kworker.0 00000100:00100000:2.0:1788568763.899225:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976278144:0@lo:400:kworker.0 00000100:00100000:2.0:1788568763.903846:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976278016 00000100:00100000:2.0:1788568763.903862:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976278016 00000100:00100000:2.0:1788568763.903924:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788568763.903947:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+19:3309:x1875449976278016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568763.904223:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925db6b8-84bc-418c-b37a-40345c1020be+19:3309:x1875449976278016:12345-0@lo:400:kworker.0 Request processed in 278us (8745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568763.904231:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788568763.904561:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925db6b8-84bc-418c-b37a-40345c1020be:3309:1875449976278016:0@lo:400:kworker.0 00000100:00080000:2.0:1788568763.904606:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788568763.904621:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788568763.904624:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788568764.407453:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788568764.407473:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976278784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788568764.407533:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568764.407671:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976278784 00000100:00100000:1.0:1788568764.407677:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976278784 00000100:00100000:1.0:1788568764.407726:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788568764.407735:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976278784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788568764.407765:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788568764.407812:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976278784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568764.407819:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788568764.407893:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976278784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788568764.597620:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568764.597881:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958470144 00000100:00100000:2.0:1788568764.597891:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958470144 00000100:00100000:2.0:1788568764.598015:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 66 00000100:00100000:2.0:1788568764.598027:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+18:12333:x1875449958470144:12345-192.168.206.4@tcp:35:umount.0 00000100:00080000:0.0:1788568764.598563:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788568764.598673:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+19:12333:x1875449958470144:12345-192.168.206.4@tcp:35:umount.0 Request processed in 647us (1059us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1788568764.598682:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 66 00010000:00010000:2.0:1788568764.600652:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568764.603793:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568764.607284:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958470400 00000100:00100000:1.0:1788568764.607303:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958470400 00000100:00100000:1.0:1788568764.607384:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 67 00000100:00100000:1.0:1788568764.607396:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+19:12333:x1875449958470400:12345-192.168.206.4@tcp:35:umount.0 00000100:00100000:1.0:1788568764.609275:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27f83c0c-e36b-48ce-9485-80051fd252dc+20:12333:x1875449958470400:12345-192.168.206.4@tcp:35:umount.0 Request processed in 1873us (5482us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1788568764.609288:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 67 00000100:00100000:0.0:1788568764.614509:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568764.614693:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958470656 00000100:00100000:2.0:1788568764.614702:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958470656 00000100:00100000:2.0:1788568764.614963:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 68 00000100:00100000:2.0:1788568764.614975:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24926ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+20:12333:x1875449958470656:12345-192.168.206.4@tcp:35:umount.0 00000100:00100000:2.0:1788568764.615223:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24926ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+21:12333:x1875449958470656:12345-192.168.206.4@tcp:35:umount.0 Request processed in 250us (722us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1788568764.615231:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 68 00000100:00100000:0.0:1788568764.625549:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568764.625651:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958470912 00000100:00100000:2.0:1788568764.625660:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958470912 00000100:00100000:2.0:1788568764.625716:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 69 00000100:00100000:2.0:1788568764.625725:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+21:12333:x1875449958470912:12345-192.168.206.4@tcp:35:umount.0 00000100:00100000:2.0:1788568764.626335:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+22:12333:x1875449958470912:12345-192.168.206.4@tcp:35:umount.0 Request processed in 608us (791us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1788568764.626344:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 69 00000100:00100000:3.0:1788568764.629696:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568764.629787:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568764.631627:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568764.631907:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958471040 00000100:00100000:1.0:1788568764.631917:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958471040 00000100:00100000:1.0:1788568764.632313:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958471168 00000100:00100000:1.0:1788568764.632318:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958471168 00000100:00100000:3.0:1788568764.632544:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568764.632582:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958471424 00000100:00100000:3.0:1788568764.632586:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958471424 00000100:00100000:3.0:1788568764.632627:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 72 00000100:00100000:3.0:1788568764.632636:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2360:x1875449958471424:12345-192.168.206.4@tcp:9:umount.0 00000020:00000080:3.0:1788568764.632663:0:6690:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x41e82f464b6a106c 00000100:00080000:3.0:1788568764.632672:0:6690:0:(import.c:65:import_set_state_nolock()) ffff9ae248e1c000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788568764.632707:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1788568764.633046:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27f83c0c-e36b-48ce-9485-80051fd252dc+2:2360:x1875449958471424:12345-192.168.206.4@tcp:9:umount.0 Request processed in 408us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568764.633054:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 72 00010000:00010000:3.0:1788568764.633088:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788568764.633095:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788568764.634602:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958471296 00000100:00100000:2.0:1788568764.634613:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958471296 00000100:00100000:2.0:1788568764.634682:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 17 00000100:00100000:2.0:1788568764.634692:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273b64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3f0f084e-5158-464d-a770-11379825208e+15:2362:x1875449958471040:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788568764.634705:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568764.634736:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae27feab800/0x41e82f464b6a0d94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea00 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568764.634752:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568764.634807:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273b64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3f0f084e-5158-464d-a770-11379825208e+14:2362:x1875449958471040:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 117us (5120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568764.634814:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 17 00000100:00100000:2.0:1788568764.634833:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 18 00000100:00100000:2.0:1788568764.634839:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3f0f084e-5158-464d-a770-11379825208e+13:2362:x1875449958471168:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788568764.634859:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568764.634869:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae27feaa000/0x41e82f464b6a0f7e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beacb expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568764.634877:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568764.634895:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3f0f084e-5158-464d-a770-11379825208e+12:2362:x1875449958471168:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 56us (5108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568764.634901:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 18 00000100:00100000:2.0:1788568764.634915:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 19 00000100:00100000:2.0:1788568764.635453:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273b67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3f0f084e-5158-464d-a770-11379825208e+11:2364:x1875449958471296:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788568764.635467:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568764.635479:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae282044a00/0x41e82f464b6a0cfa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9be9c8 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568764.635503:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568764.635529:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273b67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3f0f084e-5158-464d-a770-11379825208e+10:2364:x1875449958471296:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 608us (3909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568764.635535:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 19 00000100:00100000:3.0:1788568764.639268:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568764.639546:0:8111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958471808 00000100:00100000:1.0:1788568764.639556:0:8111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958471808 00000100:00080000:3.0:1788568764.639663:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788568764.639744:0:8111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 73 00000100:00100000:1.0:1788568764.639757:0:8111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+7:2360:x1875449958471808:12345-192.168.206.4@tcp:9:umount.0 00000020:00000080:1.0:1788568764.639787:0:8111:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x41e82f464b6a12d4 00000020:00010000:1.0:1788568764.639794:0:8111:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ae24a970000: total 0 00000100:00080000:1.0:1788568764.639798:0:8111:0:(import.c:65:import_set_state_nolock()) ffff9ae24a974800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788568764.639905:0:8111:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1788568764.640219:0:8111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+5:2360:x1875449958471808:12345-192.168.206.4@tcp:9:umount.0 Request processed in 464us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568764.640227:0:8111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 73 00000020:00010000:0.0:1788568764.643202:0:5830:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ae24a970000: total 0 00010000:00010000:0.0:1788568764.643261:0:5830:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ae24a970000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1788568764.643324:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d05415af/0x41e82f464b6a1d0e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee6e expref: 4 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568764.643362:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075aa03ab/0x41e82f464b6a1670 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beca0 expref: 3 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568764.643377:0:5830:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ae24a970000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1788568764.643388:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568764.643389:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568764.643391:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568764.654451:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568764.654524:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958472832 00000100:00100000:2.0:1788568764.654533:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958472832 00000100:00100000:2.0:1788568764.654607:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 240 00000100:00100000:2.0:1788568764.654617:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+22:2360:x1875449958472832:12345-192.168.206.4@tcp:39:umount.0 00000020:00000080:2.0:1788568764.654647:0:6714:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x41e82f464b6a0d08 00000020:00010000:2.0:1788568764.654662:0:6714:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ae26f6f9800: total 0 00000100:00080000:2.0:1788568764.654666:0:6714:0:(import.c:65:import_set_state_nolock()) ffff9ae26f6f8800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788568764.654684:0:6714:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:0.0:1788568764.655708:0:8454:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ae26f6f9800: total 0 00010000:00010000:0.0:1788568764.655763:0:8454:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ae26f6f9800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788568764.655794:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae2430ad100) 00010000:00010000:0.0:1788568764.655798:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788568764.655807:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dee00/0x41e82f464b6a16d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becbc expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568764.655826:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ae25820cd00) 00010000:00010000:0.0:1788568764.655829:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788568764.655833:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044000/0x41e82f464b6a0fee lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beae0 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568764.655885:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ae2430ad200) 00010000:00010000:0.0:1788568764.655888:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788568764.655892:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfe00/0x41e82f464b6a165b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec99 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568764.655903:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ae25820c300) 00010000:00010000:0.0:1788568764.655905:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788568764.655909:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d600/0x41e82f464b6a1ccf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee59 expref: 18 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568764.655948:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ae25820c300) 00010000:00010000:0.0:1788568764.655951:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788568764.655956:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a1cf9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee67 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568764.655982:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ae2430ad200) 00010000:00010000:0.0:1788568764.655985:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788568764.655988:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae252e7bc00/0x41e82f464b6a1631 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec8b expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568764.656011:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ae25820c700) 00010000:00010000:0.0:1788568764.656013:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788568764.656017:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2ce00/0x41e82f464b6a132f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bebc7 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568764.656028:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ae24515a400) 00010000:00010000:0.0:1788568764.656030:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788568764.656041:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae27feab600/0x41e82f464b6a0fd2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bead9 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568764.656059:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ae2430ad300) 00010000:00010000:0.0:1788568764.656061:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788568764.656065:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a19cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bed95 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568764.656076:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ae25820c300) 00010000:00010000:0.0:1788568764.656079:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788568764.656082:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d800/0x41e82f464b6a1bef lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee21 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568764.656095:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ae2430ad300) 00010000:00010000:0.0:1788568764.656097:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788568764.656100:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429df000/0x41e82f464b6a16ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9becc3 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568764.656112:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ae2430ad200) 00010000:00010000:0.0:1788568764.656114:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788568764.656118:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2da00/0x41e82f464b6a1551 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bec53 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568764.656130:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ae25820c700) 00010000:00010000:0.0:1788568764.656132:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788568764.656136:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a1042 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beaf5 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568764.656148:0:8454:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ae26f6f9800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1788568764.656168:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568764.656170:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568764.656171:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568764.656300:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27f83c0c-e36b-48ce-9485-80051fd252dc+7:2360:x1875449958472832:12345-192.168.206.4@tcp:39:umount.0 Request processed in 1682us (1854us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1788568764.656309:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 240 00000100:00100000:2.0:1788568764.919257:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788568764.919280:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b565f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976278912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788568764.919342:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568764.919483:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976278912 00000100:00100000:3.0:1788568764.919491:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976278912 00000100:00100000:3.0:1788568764.919542:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788568764.919552:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27cd87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976278912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788568764.919585:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788568764.919646:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27cd87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976278912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568764.919653:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788568764.919976:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b565f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976278912:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788568765.623569:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568766.294007:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568766.294063:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568766.294097:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568766.294704:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958472960 00000100:00100000:1.0:1788568766.294713:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958472960 00000100:00100000:1.0:1788568766.294770:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958473216 00000100:00100000:1.0:1788568766.294774:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958473216 00000100:00100000:1.0:1788568766.294785:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958473088 00000100:00100000:1.0:1788568766.294799:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958473088 00000100:00100000:1.0:1788568766.294820:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 20 00000100:00100000:1.0:1788568766.294832:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273b65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3f0f084e-5158-464d-a770-11379825208e+12:2362:x1875449958472960:12345-192.168.206.4@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788568766.294837:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 21 00010000:00010000:1.0:1788568766.294849:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788568766.294851:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273b65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3f0f084e-5158-464d-a770-11379825208e+12:2362:x1875449958473216:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788568766.294863:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788568766.294871:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae282044600/0x41e82f464b6a0dda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea15 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568766.294876:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae282044e00/0x41e82f464b6a0f77 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beac4 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568766.294894:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788568766.294908:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788568766.295056:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273b65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3f0f084e-5158-464d-a770-11379825208e+10:2362:x1875449958472960:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 227us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568766.295065:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 20 00000100:00100000:1.0:1788568766.295082:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 22 00000100:00100000:1.0:1788568766.295088:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273b64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3f0f084e-5158-464d-a770-11379825208e+9:2362:x1875449958473088:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788568766.295096:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788568766.295104:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae252e7ac00/0x41e82f464b6a0de1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea3f expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568766.295113:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788568766.303170:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273b64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3f0f084e-5158-464d-a770-11379825208e+8:2362:x1875449958473088:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 8069us (9060us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568766.303197:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 22 00000100:00100000:2.0:1788568766.303242:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273b65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3f0f084e-5158-464d-a770-11379825208e+7:2362:x1875449958473216:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 8393us (9176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568766.303252:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 21 00000100:00100000:0.0:1788568766.303651:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568766.303726:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958473472 00000100:00100000:3.0:1788568766.303734:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958473472 00000100:00100000:3.0:1788568766.303785:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 241 00000100:00100000:3.0:1788568766.303799:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b565f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be1fd6d4-5648-47eb-88cd-3d695851ff89+6:2360:x1875449958473472:12345-192.168.206.4@tcp:39:umount.0 00000020:00000080:3.0:1788568766.303833:0:5843:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x41e82f464b6a0def 00000020:00010000:3.0:1788568766.303841:0:5843:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ae26f81d800: total 0 00000100:00080000:3.0:1788568766.303844:0:5843:0:(import.c:65:import_set_state_nolock()) ffff9ae26f81a000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788568766.303871:0:5843:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1788568766.304087:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b565f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be1fd6d4-5648-47eb-88cd-3d695851ff89+5:2360:x1875449958473472:12345-192.168.206.4@tcp:39:umount.0 Request processed in 289us (437us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1788568766.304094:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 241 00000100:00080000:0.0:1788568766.304378:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:1.0:1788568766.304651:0:5831:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ae26f81d800: total 0 00010000:00010000:1.0:1788568766.304692:0:5831:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ae26f81d800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788568766.304735:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae2430ad100) 00010000:00010000:1.0:1788568766.304739:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788568766.304747:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c400/0x41e82f464b6a1d1c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee75 expref: 4 pid: 12276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568766.304768:0:5831:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ae26f81d800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788568766.304779:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568766.304781:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568766.304783:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568766.333053:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568766.333145:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958473728 00000100:00100000:1.0:1788568766.333156:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958473728 00000100:00100000:1.0:1788568766.333214:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 305 00000100:00100000:1.0:1788568766.333223:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+7:2360:x1875449958473728:12345-192.168.206.4@tcp:251:umount.0 00000020:00000080:1.0:1788568766.333263:0:5835:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x41e82f464b6a0ce5 00000020:00010000:1.0:1788568766.333271:0:5835:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ae27bede800: total 0 00000100:00080000:1.0:1788568766.333282:0:5835:0:(import.c:65:import_set_state_nolock()) ffff9ae27bedb800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788568766.333351:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f0f084e-5158-464d-a770-11379825208e+3:2360:x1875449958473728:12345-192.168.206.4@tcp:251:umount.0 Request processed in 125us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568766.333359:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 305 00000020:00010000:0.0:1788568766.334144:0:5830:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ae27bede800: total 0 00010000:00010000:0.0:1788568766.334150:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568766.334187:0:5830:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ae27bede800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788568766.334219:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae27feaba00/0x41e82f464b6a0d9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bea07 expref: 2 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568766.334233:0:5830:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ae27bede800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1788568766.334242:0:5830:0:(genops.c:885:class_export_put()) final put ffff9ae27bede800/3f0f084e-5158-464d-a770-11379825208e 00010000:00010000:0.0:1788568766.334262:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568766.334264:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568766.334266:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788568766.334311:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae27bede800/3f0f084e-5158-464d-a770-11379825208e for MGS 00000020:00000080:2.0:1788568766.334346:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae27bedb800 for MGS 00010000:00010000:0.0:1788568766.647191:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568767.672751:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788568767.773622:0:13021:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788568767.789233:0:13021:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788568767.789284:0:13021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae27feaaa00/0x41e82f464b6a0d6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0d71 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568767.789301:0:13021:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae27feaaa00/0x41e82f464b6a0d6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0d71 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568767.789309:0:13021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae27feaaa00/0x41e82f464b6a0d6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x41e82f464b6a0d71 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568767.789316:0:13021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.104@tcp lock: ffff9ae27feaaa00/0x41e82f464b6a0d6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x41e82f464b6a0d71 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568767.789370:0:13021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788568767.789376:0:13021:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788568767.789400:0:13021:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788568767.789404:0:13021:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788568767.789410:0:13021:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788568767.789436:0:13021:0:(import.c:65:import_set_state_nolock()) ffff9ae28173d000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788568767.789854:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273980e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875449976279040:0@lo:39:umount.0 00000100:00100000:3.0:1788568767.789920:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568767.790704:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976279040 00000100:00100000:2.0:1788568767.790725:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976279040 00000100:00100000:2.0:1788568767.791023:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788568767.791036:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875449976279040:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788568767.791066:0:5844:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x41e82f464b6a0af4 00000100:00080000:2.0:1788568767.791076:0:5844:0:(import.c:65:import_set_state_nolock()) ffff9ae27ccb2800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788568767.791143:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788568767.791152:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae27feaaa00/0x41e82f464b6a0d6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x41e82f464b6a0d71 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568767.791161:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaaa00 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:1.0:1788568767.791172:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae27feaaa00/0x41e82f464b6a0d6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x41e82f464b6a0d71 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568767.791181:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae27feaaa00/0x41e82f464b6a0d6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x41e82f464b6a0d71 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788568767.791189:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae27feaaa00/0x41e82f464b6a0d6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x41e82f464b6a0d71 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788568767.791195:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788568767.791198:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788568767.791200:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788568767.791237:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae27feaaa00/0x41e82f464b6a0d6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x41e82f464b6a0d71 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568767.791244:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788568767.791273:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae27feaaa00/0x41e82f464b6a0d6a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x41e82f464b6a0d71 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568767.791282:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae27feaaa00/0x41e82f464b6a0d6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x41e82f464b6a0d71 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568767.791294:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568767.791296:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568767.791298:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568767.791306:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788568767.791317:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:925db6b8-84bc-418c-b37a-40345c1020be:3308:1875449976279168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788568767.791371:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568767.791581:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976279168 00000100:00100000:3.0:1788568767.791587:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976279168 00000100:00100000:3.0:1788568767.791628:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788568767.791636:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25319e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:925db6b8-84bc-418c-b37a-40345c1020be+19:3308:x1875449976279168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788568767.791645:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568767.791659:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae282045e00/0x41e82f464b6a0d71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x41e82f464b6a0d6a expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568767.791672:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788568767.791710:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25319e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:925db6b8-84bc-418c-b37a-40345c1020be+18:3308:x1875449976279168:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568767.791717:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788568767.791789:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:925db6b8-84bc-418c-b37a-40345c1020be:3308:1875449976279168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788568767.793370:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3305:x1875449976279040:12345-0@lo:39:umount.0 Request processed in 2333us (3443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568767.793381:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1788568767.793391:0:5844:0:(genops.c:885:class_export_put()) final put ffff9ae27ccb0800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:3.0:1788568767.793852:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ae28173d000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788568767.793866:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273980e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875449976279040:0@lo:39:umount.0 00000100:00080000:3.0:1788568767.793892:0:13021:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788568767.793896:0:13021:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788568767.793900:0:13021:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788568767.794692:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568767.794840:0:13021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b000/0x41e82f464b6a0d78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0d7f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568767.794852:0:13021:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b000/0x41e82f464b6a0d78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0d7f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568767.794859:0:13021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b000/0x41e82f464b6a0d78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x41e82f464b6a0d7f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568767.794866:0:13021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b000/0x41e82f464b6a0d78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x41e82f464b6a0d7f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568767.794890:0:13021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788568767.794897:0:13021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae240030800/0x41e82f464b6a0c9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0ca6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568767.794903:0:13021:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae240030800/0x41e82f464b6a0c9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0ca6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568767.794909:0:13021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae240030800/0x41e82f464b6a0c9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x41e82f464b6a0ca6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568767.794915:0:13021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.104@tcp lock: ffff9ae240030800/0x41e82f464b6a0c9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x41e82f464b6a0ca6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788568767.794937:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae27ccb0800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00010000:00010000:3.0:1788568767.794954:0:13021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788568767.794965:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788568767.794969:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b000/0x41e82f464b6a0d78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x41e82f464b6a0d7f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568767.794987:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7b000 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:3.0:1788568767.794991:0:8455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b000/0x41e82f464b6a0d78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x41e82f464b6a0d7f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568767.794998:0:8455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b000/0x41e82f464b6a0d78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x41e82f464b6a0d7f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788568767.794999:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae27ccb2800 for lustre-MDT0000 10000000:00010000:3.0:1788568767.795005:0:8455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b000/0x41e82f464b6a0d78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x41e82f464b6a0d7f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788568767.795011:0:8455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788568767.795014:0:8455:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1788568767.795044:0:8455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b000/0x41e82f464b6a0d78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x41e82f464b6a0d7f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568767.795049:0:8455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788568767.795068:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b000/0x41e82f464b6a0d78 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x41e82f464b6a0d7f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568767.795075:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b000/0x41e82f464b6a0d78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x41e82f464b6a0d7f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568767.795086:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788568767.795089:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae240030800/0x41e82f464b6a0c9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x41e82f464b6a0ca6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568767.795106:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae240030800 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:3.0:1788568767.795109:0:8455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae240030800/0x41e82f464b6a0c9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x41e82f464b6a0ca6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568767.795116:0:8455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae240030800/0x41e82f464b6a0c9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x41e82f464b6a0ca6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788568767.795122:0:8455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae240030800/0x41e82f464b6a0c9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x41e82f464b6a0ca6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788568767.795127:0:8455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788568767.795129:0:8455:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788568767.795131:0:8455:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788568767.795147:0:8455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae240030800/0x41e82f464b6a0c9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x41e82f464b6a0ca6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568767.795153:0:8455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788568767.795159:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae240030800/0x41e82f464b6a0c9f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x41e82f464b6a0ca6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568767.795166:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae240030800/0x41e82f464b6a0c9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x41e82f464b6a0ca6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568767.795179:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568767.795180:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568767.795182:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568767.795197:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925db6b8-84bc-418c-b37a-40345c1020be:3307:1875449976279424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788568767.795247:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568767.795295:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788568767.795309:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273b64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925db6b8-84bc-418c-b37a-40345c1020be:3307:1875449976279296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788568767.795332:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568767.795361:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976279424 00000100:00100000:3.0:1788568767.795367:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976279424 00000100:00100000:3.0:1788568767.795403:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976279296 00000100:00100000:3.0:1788568767.795407:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976279296 00000100:00100000:3.0:1788568767.795427:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788568767.795434:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273b67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:925db6b8-84bc-418c-b37a-40345c1020be+19:3307:x1875449976279424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788568767.795445:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568767.795457:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae282045200/0x41e82f464b6a0ca6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x41e82f464b6a0c9f expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568767.795471:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788568767.795503:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273b67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:925db6b8-84bc-418c-b37a-40345c1020be+18:3307:x1875449976279424:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568767.795509:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788568767.795523:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788568767.795529:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273b65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:925db6b8-84bc-418c-b37a-40345c1020be+17:3307:x1875449976279296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788568767.795535:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568767.795543:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae282045a00/0x41e82f464b6a0d7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x41e82f464b6a0d78 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568767.795551:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788568767.795569:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273b65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:925db6b8-84bc-418c-b37a-40345c1020be+16:3307:x1875449976279296:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568767.795575:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788568767.795603:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273b64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925db6b8-84bc-418c-b37a-40345c1020be:3307:1875449976279296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788568767.795611:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925db6b8-84bc-418c-b37a-40345c1020be:3307:1875449976279424:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788568767.795639:0:13021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a400/0x41e82f464b6a0fa1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0fa8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568767.795646:0:13021:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a400/0x41e82f464b6a0fa1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0fa8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568767.795651:0:13021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a400/0x41e82f464b6a0fa1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x41e82f464b6a0fa8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568767.795657:0:13021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a400/0x41e82f464b6a0fa1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x41e82f464b6a0fa8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568767.795666:0:13021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788568767.795669:0:13021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae240031800/0x41e82f464b6a0a53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0a5a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568767.795674:0:13021:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae240031800/0x41e82f464b6a0a53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0a5a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568767.795679:0:13021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae240031800/0x41e82f464b6a0a53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x41e82f464b6a0a5a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568767.795684:0:13021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.104@tcp lock: ffff9ae240031800/0x41e82f464b6a0a53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x41e82f464b6a0a5a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568767.795691:0:13021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788568767.795693:0:13021:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1788568767.795696:0:13021:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1788568767.795724:0:13021:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788568767.795727:0:13021:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788568767.795736:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:1.0:1788568767.796118:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788568767.796130:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a400/0x41e82f464b6a0fa1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x41e82f464b6a0fa8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568767.796136:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7a400 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:1.0:1788568767.796139:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a400/0x41e82f464b6a0fa1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x41e82f464b6a0fa8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568767.796146:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a400/0x41e82f464b6a0fa1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x41e82f464b6a0fa8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788568767.796153:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a400/0x41e82f464b6a0fa1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x41e82f464b6a0fa8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788568767.796158:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788568767.796161:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788568767.796163:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788568767.796181:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a400/0x41e82f464b6a0fa1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x41e82f464b6a0fa8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568767.796187:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788568767.796206:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a400/0x41e82f464b6a0fa1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x41e82f464b6a0fa8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568767.796212:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:925db6b8-84bc-418c-b37a-40345c1020be:3308:1875449976279552:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788568767.796213:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a400/0x41e82f464b6a0fa1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x41e82f464b6a0fa8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568767.796222:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788568767.796225:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae240031800/0x41e82f464b6a0a53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x41e82f464b6a0a5a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568767.796231:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae240031800 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:1.0:1788568767.796238:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae240031800/0x41e82f464b6a0a53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x41e82f464b6a0a5a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568767.796242:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788568767.796246:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae240031800/0x41e82f464b6a0a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x41e82f464b6a0a5a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788568767.796253:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae240031800/0x41e82f464b6a0a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x41e82f464b6a0a5a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788568767.796258:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788568767.796260:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788568767.796261:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788568767.796274:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae240031800/0x41e82f464b6a0a53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x41e82f464b6a0a5a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568767.796279:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788568767.796290:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae240031800/0x41e82f464b6a0a53 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x41e82f464b6a0a5a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568767.796297:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae240031800/0x41e82f464b6a0a53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x41e82f464b6a0a5a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568767.796318:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568767.796319:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568767.796321:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568767.796367:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788568767.796376:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:925db6b8-84bc-418c-b37a-40345c1020be:3308:1875449976279680:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788568767.796387:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568767.796400:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568767.796511:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568767.796553:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976279552 00000100:00100000:0.0:1788568767.796559:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976279552 00000100:00100000:0.0:1788568767.796595:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976279680 00000100:00100000:0.0:1788568767.796598:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976279680 00000100:00100000:0.0:1788568767.796624:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788568767.796631:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273980e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:925db6b8-84bc-418c-b37a-40345c1020be+17:3308:x1875449976279552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788568767.796640:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788568767.796646:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1788568767.796649:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae252e7ba00/0x41e82f464b6a0fa8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x41e82f464b6a0fa1 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568767.796653:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:925db6b8-84bc-418c-b37a-40345c1020be+17:3308:x1875449976279680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788568767.796661:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568767.796668:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788568767.796669:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae2429de400/0x41e82f464b6a0a5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x41e82f464b6a0a53 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568767.796679:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788568767.796706:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273980e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:925db6b8-84bc-418c-b37a-40345c1020be+15:3308:x1875449976279552:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568767.796713:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000020:00000080:3.0:1788568767.796844:0:13021:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:3.0:1788568767.796850:0:13021:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9ae26f6fc000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788568767.796857:0:13021:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9ae277912800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788568767.796863:0:13021:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9ae26f81d800 be1fd6d4-5648-47eb-88cd-3d695851ff89 192.168.206.4@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788568767.796868:0:13021:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9ae26f6f9800 27f83c0c-e36b-48ce-9485-80051fd252dc 192.168.206.4@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967520 stale:0 00000020:00080000:3.0:1788568767.796873:0:13021:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9ae281c019c0) has exports, disconnecting them 00000020:00080000:3.0:1788568767.796878:0:13021:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ae26f6fc000), last request at 1788568763 00000020:00000080:3.0:1788568767.796884:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x41e82f464b6a0c67 00000100:00100000:2.0:1788568767.796893:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:925db6b8-84bc-418c-b37a-40345c1020be+14:3308:x1875449976279680:12345-0@lo:103:ldlm_bl.0 Request processed in 241us (382us total) trans 0 rc 0/0 00000100:00080000:3.0:1788568767.796897:0:13021:0:(import.c:65:import_set_state_nolock()) ffff9ae26f6f8000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788568767.796900:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1788568767.796953:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788568767.796966:0:13021:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ae26f6fc000): rc 0 00000020:00000080:3.0:1788568767.796969:0:13021:0:(genops.c:885:class_export_put()) final put ffff9ae26f6fc000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788568767.796988:0:13021:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ae277912800), last request at 1788568763 00000020:00000080:3.0:1788568767.796991:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x41e82f464b6a0b9c 00000100:00080000:3.0:1788568767.796997:0:13021:0:(import.c:65:import_set_state_nolock()) ffff9ae277911000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788568767.797006:0:13021:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ae277912800): rc 0 00000020:00000080:3.0:1788568767.797008:0:13021:0:(genops.c:885:class_export_put()) final put ffff9ae277912800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1788568767.797014:0:13021:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbd7901c7bae0 00000020:00000080:2.0:1788568767.797018:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae26f6fc000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00080000:3.0:1788568767.797030:0:13021:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788568767.797033:0:13021:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:3.0:1788568767.797044:0:13021:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:2.0:1788568767.797052:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae277912800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788568767.797072:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae26f6f8000 for lustre-MDT0000 00000020:00000080:2.0:1788568767.797082:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae277911000 for lustre-MDT0000 00000100:00080000:3.0:1788568767.797099:0:13021:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788568767.797112:0:13021:0:(import.c:65:import_set_state_nolock()) ffff9ae2735ac000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788568767.797136:0:13021:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788568767.797138:0:13021:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1788568767.797145:0:13021:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788568767.797205:0:13021:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1788568767.797211:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:925db6b8-84bc-418c-b37a-40345c1020be:3308:1875449976279680:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788568767.797215:0:13021:0:(import.c:65:import_set_state_nolock()) ffff9ae27fd8f000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788568767.797219:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:925db6b8-84bc-418c-b37a-40345c1020be:3308:1875449976279552:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788568767.797239:0:13021:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9ae281c019c0) has no exports 00010000:00010000:1.0:1788568767.797321:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568767.797387:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875449976279808:0@lo:9:umount.0 00000100:00100000:2.0:1788568767.797421:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568767.797525:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976279808 00000100:00100000:1.0:1788568767.797530:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976279808 00000100:00100000:1.0:1788568767.797570:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788568767.797577:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875449976279808:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788568767.797596:0:6690:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x41e82f464b6a0bf7 00000100:00080000:1.0:1788568767.797608:0:6690:0:(import.c:65:import_set_state_nolock()) ffff9ae277a7f000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788568767.797638:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1788568767.797867:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3305:x1875449976279808:12345-0@lo:9:umount.0 Request processed in 289us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568767.797874:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1788568767.797906:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788568767.797910:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273b64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875449976279936:0@lo:9:umount.0 00010000:00010000:0.0:1788568767.797913:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568767.797962:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788568767.798008:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ae2735ac000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788568767.798021:0:3305:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788568767.798023:0:3305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788568767.798026:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875449976279808:0@lo:9:umount.0 00000100:00100000:0.0:1788568767.798188:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976279936 00000100:00100000:0.0:1788568767.798193:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976279936 00000100:00100000:0.0:1788568767.798236:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788568767.798243:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875449976279936:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788568767.798256:0:6691:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x41e82f464b6a0cd0 00000100:00080000:0.0:1788568767.798261:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9ae26f6ff000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788568767.798294:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00080000:1.0:1788568767.798410:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788568767.798677:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3305:x1875449976279936:12345-0@lo:9:umount.0 Request processed in 434us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568767.798684:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:0.0:1788568767.798699:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788568767.798731:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ae27fd8f000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788568767.798841:0:3305:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788568767.798919:0:3305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788568767.798924:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273b64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875449976279936:0@lo:9:umount.0 00000020:00080000:3.0:1788568767.804840:0:13021:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9ae281c019c0) has no exports 00000020:00000080:3.0:1788568767.847630:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x41e82f464b6a0aae 00000020:00000080:3.0:1788568767.847643:0:13021:0:(genops.c:885:class_export_put()) final put ffff9ae2527af800/lustre-QMT0000_UUID 00000020:01000000:3.0:1788568767.847708:0:13021:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788568767.847905:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788568767.847916:0:13021:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788568767.847921:0:13021:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9ae251de3380) has no exports 00000020:00000080:0.0:1788568767.848263:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x41e82f464b6a0aa7 00000020:00000080:0.0:1788568767.848269:0:13021:0:(genops.c:885:class_export_put()) final put ffff9ae27ccb5800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788568767.848395:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae2527af800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788568767.848547:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae27ccb5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788568767.848667:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788568767.848675:0:13021:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788568767.848678:0:13021:0:(genops.c:885:class_export_put()) final put ffff9ae281739800/lustre-QMT0000_UUID 00000020:00000080:0.0:1788568767.848680:0:13021:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae281739800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788568767.848687:0:13021:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:3.0:1788568768.695841:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568769.015679:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788568769.015725:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875449976280320:0@lo:400:kworker.0 00000100:00100000:2.0:1788568769.015814:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568769.015897:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976280320 00000100:00100000:2.0:1788568769.015905:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976280320 00000100:00100000:2.0:1788568769.015993:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788568769.016002:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3309:x1875449976280320:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788568769.016011:0:6714:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788568769.016059:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3309:x1875449976280320:12345-0@lo:400:kworker.0 Request processed in 55us (244us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788568769.016066:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:2.0:1788568769.016138:0:3309:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788568769.016144:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9ae27ff27000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788568769.016149:0:3309:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1788568769.016355:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875449976280192:0@lo:400:kworker.0 00000100:00100000:3.0:1788568769.016402:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568769.016444:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788568769.016451:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925db6b8-84bc-418c-b37a-40345c1020be:3307:1875449976280064:0@lo:400:kworker.0 00000100:00100000:3.0:1788568769.016486:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568769.016525:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976280192 00000100:00100000:3.0:1788568769.016530:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976280192 00000100:00100000:3.0:1788568769.016560:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788568769.016565:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273b64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3307:x1875449976280192:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788568769.016571:0:5843:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788568769.016603:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273b64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3307:x1875449976280192:12345-0@lo:400:kworker.0 Request processed in 36us (200us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788568769.016610:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788568769.016630:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976280064 00000100:00100000:3.0:1788568769.016634:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976280064 00000100:00100000:3.0:1788568769.016664:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1788568769.016671:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae248d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+14:3307:x1875449976280064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568769.016711:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae248d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925db6b8-84bc-418c-b37a-40345c1020be+14:3307:x1875449976280064:12345-0@lo:400:kworker.0 Request processed in 41us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568769.016718:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1788568769.017500:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925db6b8-84bc-418c-b37a-40345c1020be:3307:1875449976280064:0@lo:400:kworker.0 00000100:00080000:3.0:1788568769.017518:0:3307:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788568769.017523:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9ae27fd8c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788568769.017527:0:3307:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788568769.017534:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9ae27fd8c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788568769.017538:0:3307:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 190 00000100:00080000:3.0:1788568769.017546:0:3307:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ae27fd8c800 using connection 192.168.206.104@tcp/0@lo 00000100:00100000:3.0:1788568769.017580:0:3307:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae273b65500 x1875449976280448/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788568769.017604:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875449976280192:0@lo:400:kworker.0 00000100:00100000:0.0:1788568769.023158:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1875449976280448:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788568769.023263:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568769.027343:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976280448 00000100:00100000:0.0:1788568769.027360:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976280448 00000100:00100000:0.0:1788568769.027782:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788568769.027797:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b567100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1875449976280448:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1788568769.027819:0:5844:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:2.0:1788568769.034518:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9ae27ff27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788568769.034530:0:3309:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 208 00000100:00080000:2.0:1788568769.034542:0:3309:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ae27ff27000 using connection 192.168.206.104@tcp/0@lo 00000100:00100000:2.0:1788568769.034597:0:3309:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae2739f2a00 x1875449976280576/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788568769.034634:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875449976280320:0@lo:400:kworker.0 00000100:00100000:2.0:1788568769.039193:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1875449976280576:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788568769.039290:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568769.039361:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976280576 00000100:00100000:2.0:1788568769.041040:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976280576 00000100:00100000:2.0:1788568769.041176:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788568769.041188:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1875449976280576:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1788568769.041212:0:5842:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788568769.041306:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1875449976280576:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 118us (2016us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788568769.041315:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:2.0:1788568769.043880:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ae27ff27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788568769.043899:0:3305:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788568769.043906:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1875449976280576:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1788568769.065357:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b567100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1875449976280448:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 37553us (42084us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788568769.065375:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:0.0:1788568769.065443:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ae27fd8c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788568769.065449:0:3305:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788568769.065454:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1875449976280448:0@lo:38:ptlrpcd_00_01.0 00000001:00100000:3.0:1788568769.096497:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788568769.096510:0:6717:0:(genops.c:885:class_export_put()) final put ffff9ae277a7a800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788568769.096539:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 27f83c0c-e36b-48ce-9485-80051fd252dc 00000020:00000080:3.0:1788568769.096542:0:6717:0:(genops.c:885:class_export_put()) final put ffff9ae24a970000/27f83c0c-e36b-48ce-9485-80051fd252dc 00000020:00000080:2.0:1788568769.099603:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae277a7a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788568769.099692:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae24a970000/27f83c0c-e36b-48ce-9485-80051fd252dc for lustre-OST0000 00000020:00000080:2.0:1788568769.099752:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae277a7f000 for lustre-OST0000 00000020:00000080:2.0:1788568769.099764:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae24a974800 for lustre-OST0000 00000001:00100000:2.0:1788568769.101559:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788568769.101572:0:7647:0:(genops.c:885:class_export_put()) final put ffff9ae27ccb4000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788568769.101611:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 27f83c0c-e36b-48ce-9485-80051fd252dc 00000020:00000080:2.0:1788568769.101614:0:7647:0:(genops.c:885:class_export_put()) final put ffff9ae248e1c800/27f83c0c-e36b-48ce-9485-80051fd252dc 00000020:00000080:3.0:1788568769.102647:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae27ccb4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788568769.102715:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae248e1c800/27f83c0c-e36b-48ce-9485-80051fd252dc for lustre-OST0001 00000020:00000080:3.0:1788568769.102732:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae26f6ff000 for lustre-OST0001 00000020:00000080:3.0:1788568769.102737:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae248e1c000 for lustre-OST0001 00000001:00080000:3.0:1788568769.112234:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000001:00100000:3.0:1788568769.112262:0:5865:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 27f83c0c-e36b-48ce-9485-80051fd252dc 00000001:00080000:3.0:1788568769.112268:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:3.0:1788568769.112279:0:5865:0:(genops.c:885:class_export_put()) final put ffff9ae26f6f9800/27f83c0c-e36b-48ce-9485-80051fd252dc 00000001:00100000:3.0:1788568769.112307:0:5865:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of be1fd6d4-5648-47eb-88cd-3d695851ff89 00000001:00080000:3.0:1788568769.112314:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1788568769.112316:0:5865:0:(genops.c:885:class_export_put()) final put ffff9ae26f81d800/be1fd6d4-5648-47eb-88cd-3d695851ff89 00000020:00000080:2.0:1788568769.112739:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae26f6f9800/27f83c0c-e36b-48ce-9485-80051fd252dc for lustre-MDT0000 00000020:00000080:2.0:1788568769.112836:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae26f81d800/be1fd6d4-5648-47eb-88cd-3d695851ff89 for lustre-MDT0000 00000020:00000080:2.0:1788568769.112870:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae26f6f8800 for lustre-MDT0000 00000020:00000080:2.0:1788568769.112875:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae26f81a000 for lustre-MDT0000 00010000:00010000:1.0:1788568769.720269:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788568769.911254:0:13021:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ae27b96a7e0 - data ffff9ae277e7ed80/ffff9ae281a6f400 00000020:01000000:0.0:1788568769.911696:0:13021:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ae27b96a4e0 - data ffff9ae245c24a20/ffff9ae2734acc00 00000001:00000004:0.0:1788568769.921359:0:13021:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1788568770.061835:0:13021:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788568770.061844:0:13021:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1788568770.062586:0:13021:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788568770.062590:0:13021:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788568770.063261:0:7136:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788568770.063268:0:7136:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1788568770.063278:0:7136:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788568770.064457:0:13021:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788568770.064462:0:13021:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1788568770.064475:0:13021:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788568770.064478:0:13021:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788568770.065464:0:7893:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788568770.065469:0:7893:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1788568770.065479:0:7893:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788568770.130953:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x41e82f464b6a0a76 00000020:00000080:2.0:1788568770.130977:0:13021:0:(genops.c:885:class_export_put()) final put ffff9ae27bf72000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788568770.131038:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae27bf72000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788568770.132848:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x41e82f464b6a0a8b 00000020:00000080:2.0:1788568770.132859:0:13021:0:(genops.c:885:class_export_put()) final put ffff9ae27bf75000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788568770.132879:0:13021:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788568770.132887:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788568770.132896:0:13021:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788568770.132906:0:13021:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9ae26b2d99c0) has no exports 00000020:00000080:1.0:1788568770.132950:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae27bf75000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:2.0:1788568770.133140:0:13021:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788568770.133150:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x41e82f464b6a0cc9 00000020:00000080:2.0:1788568770.133156:0:13021:0:(genops.c:885:class_export_put()) final put ffff9ae27ccb6800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788568770.133169:0:13021:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788568770.133190:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae27ccb6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788568770.137723:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788568770.137737:0:13021:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788568770.137742:0:13021:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9ae26fb7cd40) has no exports 00000020:00000080:2.0:1788568770.137752:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x41e82f464b6a0cc2 00000020:00000080:2.0:1788568770.137772:0:13021:0:(genops.c:885:class_export_put()) final put ffff9ae27fd8a800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788568770.138017:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae27fd8a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788568770.138384:0:13021:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788568770.138388:0:13021:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788568770.138392:0:13021:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1788568770.138398:0:13021:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788568770.138400:0:13021:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788568770.138443:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788568770.138450:0:13021:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788568770.138457:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x41e82f464b6a0be2 00000020:00000080:1.0:1788568770.138460:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae27fd8f000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788568770.138462:0:13021:0:(genops.c:885:class_export_put()) final put ffff9ae277a7d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788568770.138465:0:36:0:(genops.c:885:class_export_put()) final put ffff9ae277a79000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788568770.138467:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae277a79000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788568770.138472:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788568770.138476:0:13021:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788568770.138479:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788568770.138483:0:13021:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788568770.138485:0:13021:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9ae26fb78000) has no exports 00000020:00000080:2.0:1788568770.138489:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x41e82f464b6a0bdb 00000020:00000080:2.0:1788568770.138492:0:13021:0:(genops.c:885:class_export_put()) final put ffff9ae2735ae800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788568770.138546:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae277a7d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788568770.138551:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae2735ae800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788568770.140452:0:13021:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788568770.140459:0:13021:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788568770.140463:0:13021:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1788568770.140469:0:13021:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788568770.140471:0:13021:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788568770.140540:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae2735ac000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788568770.142152:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788568770.142167:0:13021:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788568770.142173:0:13021:0:(genops.c:885:class_export_put()) final put ffff9ae2735aa000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788568770.142178:0:13021:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae2735aa000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788568770.142186:0:13021:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788568770.142362:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788568770.142375:0:13021:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788568770.142379:0:13021:0:(genops.c:885:class_export_put()) final put ffff9ae2527ac800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788568770.142381:0:13021:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae2527ac800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788568770.142386:0:13021:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788568770.142487:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x41e82f464b6a0a92 00000020:00000080:2.0:1788568770.142494:0:13021:0:(genops.c:885:class_export_put()) final put ffff9ae27bf70800/lustre-MDD0000_UUID 00000020:01000000:2.0:1788568770.142523:0:13021:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788568770.142528:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788568770.142533:0:13021:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788568770.142536:0:13021:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9ae281c03380) has no exports 00000020:00000080:2.0:1788568770.142553:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788568770.142556:0:13021:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788568770.142559:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x41e82f464b6a0a99 00000020:00000080:2.0:1788568770.142563:0:13021:0:(genops.c:885:class_export_put()) final put ffff9ae27bf71000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788568770.142570:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae27bf70800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000004:2.0:1788568770.142574:0:13021:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ae26b352000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788568770.142577:0:37:0:(genops.c:885:class_export_put()) final put ffff9ae27bf76000/lustre-MDD0000_UUID 00000020:01000004:2.0:1788568770.142579:0:13021:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae26b352000 3 00000020:00000080:0.0:1788568770.142581:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae27bf76000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000004:2.0:1788568770.142584:0:13021:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ae26b352000 from lustre-MDT0000 00000020:01000000:0.0:1788568770.142606:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788568770.142607:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788568770.142612:0:13021:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788568770.142615:0:13021:0:(genops.c:885:class_export_put()) final put ffff9ae27bf72800/lustre-MDT0000_UUID 00000020:00000080:2.0:1788568770.142617:0:13021:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae27bf72800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788568770.142624:0:13021:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788568770.142660:0:13021:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1788568770.142663:0:13021:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788568770.142666:0:13021:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788568770.142669:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788568770.142672:0:13021:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788568770.142679:0:13021:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9ae26b354000 925db6b8-84bc-418c-b37a-40345c1020be 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788568770.142684:0:13021:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9ae26b2d8000) has exports, disconnecting them 00000020:00080000:2.0:1788568770.142689:0:13021:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9ae26b354000), last request at 1788568537 00000020:00000080:2.0:1788568770.142703:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x41e82f464b6a0a37 00000020:00010000:2.0:1788568770.142708:0:13021:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ae26b354000: total 2 00000100:00080000:2.0:1788568770.142719:0:13021:0:(import.c:65:import_set_state_nolock()) ffff9ae248c63000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788568770.142735:0:13021:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ae26b354000): rc 0 00000020:00080000:2.0:1788568770.142739:0:13021:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9ae26b2d8000) has no exports 00000020:00000080:0.0:1788568770.142784:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae27bf71000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:0.0:1788568770.142797:0:8454:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ae26b354000: total 0 00010000:00010000:0.0:1788568770.142822:0:8454:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ae26b354000, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1788568770.142848:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae282045000/0x41e82f464b6a0d63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x41e82f464b6a0d5c expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568770.142865:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae282045c00/0x41e82f464b6a0b4f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x41e82f464b6a0b48 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568770.142878:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae27feab200/0x41e82f464b6a0d8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x41e82f464b6a0d86 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568770.142888:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae252e7b800/0x41e82f464b6a0f8c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x41e82f464b6a0f85 expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568770.142897:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae2429df600/0x41e82f464b6a0f9a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x41e82f464b6a0f93 expref: 5 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568770.142909:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae27feaae00/0x41e82f464b6a0d39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x41e82f464b6a0d32 expref: 4 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568770.142949:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae2429df800/0x41e82f464b6a0d47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x41e82f464b6a0d40 expref: 3 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568770.142960:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae282044400/0x41e82f464b6a0d55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x41e82f464b6a0d4e expref: 2 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568770.142984:0:8454:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ae26b354000, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1788568770.143001:0:8454:0:(genops.c:885:class_export_put()) final put ffff9ae26b354000/925db6b8-84bc-418c-b37a-40345c1020be 00010000:00010000:0.0:1788568770.143013:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568770.143016:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568770.143018:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788568770.143021:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae26b354000/925db6b8-84bc-418c-b37a-40345c1020be for MGS 00000020:00000080:1.0:1788568770.143070:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae248c63000 for MGS 00000100:00100000:0.0:1788568770.150255:0:5834:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9ae2527d1000:5834] 0 exiting: rc = 1 00000100:00100000:2.0:1788568770.151282:0:5836:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9ae248077400:5836] 2 exiting: rc = 0 00000100:00100000:1.0:1788568770.151993:0:5835:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9ae248058a00:5835] 1 exiting: rc = 0 00000100:00100000:0.0:1788568770.152124:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152133:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152139:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152144:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152150:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152157:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152162:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152168:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152181:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152187:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152192:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152197:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152203:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152207:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152213:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152218:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152225:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152230:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152236:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152242:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152248:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152253:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152260:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152265:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152271:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152277:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152281:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152287:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152292:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152298:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152303:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152309:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152314:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152318:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152324:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152345:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152349:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152353:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152358:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152363:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152368:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152378:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152383:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152389:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152394:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152399:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152404:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152410:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152415:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152420:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152425:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152430:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152434:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152439:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152444:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152448:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152453:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152459:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152464:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152469:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152474:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152478:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152483:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.152488:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1788568770.152884:0:13021:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788568770.152888:0:13021:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1788568770.154809:0:13021:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ae251c448a0 - data ffff9ae245ffe798/ffff9ae26f68b400 00000020:01000000:2.0:1788568770.154910:0:13021:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ae250aeb3c0 - data ffff9ae270b61288/ffff9ae247f2d000 00000020:00000080:2.0:1788568770.155369:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x41e82f464b6a0a1b 00000020:00000080:2.0:1788568770.155376:0:13021:0:(genops.c:885:class_export_put()) final put ffff9ae26b355800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788568770.155394:0:13021:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ae26b352000 from MGS, refs=2 00000020:01000004:2.0:1788568770.155397:0:13021:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae26b352000 2 00000020:01000004:2.0:1788568770.155401:0:13021:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ae26b352000 from MGS 00000020:00000080:2.0:1788568770.155420:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788568770.155426:0:13021:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788568770.155429:0:13021:0:(genops.c:885:class_export_put()) final put ffff9ae26b353800/MGS 00000020:00000080:2.0:1788568770.155431:0:13021:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae26b353800/MGS for MGS 00000020:01000000:2.0:1788568770.155437:0:13021:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788568770.155486:0:13021:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788568770.155490:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788568770.155495:0:13021:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788568770.155502:0:13021:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9ae280c9f800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788568770.155507:0:13021:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9ae281c00000) has exports, disconnecting them 00000020:00080000:2.0:1788568770.155511:0:13021:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9ae280c9f800), last request at 1788568538 00000020:00000080:2.0:1788568770.155527:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x41e82f464b6a0ae6 00000020:00080000:2.0:1788568770.155535:0:13021:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ae280c9f800): rc 0 00000020:00000080:2.0:1788568770.155538:0:13021:0:(genops.c:885:class_export_put()) final put ffff9ae280c9f800/lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788568770.156064:0:13021:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788568770.156069:0:13021:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788568770.156073:0:13021:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788568770.156078:0:13021:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788568770.156186:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788568770.156202:0:13021:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788568770.156206:0:13021:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae26b352000 1 00000020:00000080:2.0:1788568770.156210:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x41e82f464b6a0a0d 00000020:00000080:2.0:1788568770.156215:0:13021:0:(genops.c:885:class_export_put()) final put ffff9ae26b351800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788568770.156219:0:13021:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788568770.156222:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788568770.156224:0:13021:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788568770.156227:0:13021:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9ae26b2db380) has no exports 00000020:00000080:1.0:1788568770.156357:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae26b355800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788568770.156367:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae280c9f800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788568770.156371:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae28173d000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788568770.156376:0:37:0:(genops.c:885:class_export_put()) final put ffff9ae280c9d800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788568770.156378:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae280c9d800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788568770.156381:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788568770.156425:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae26b351800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788568770.244024:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788568770.244038:0:13021:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788568770.244044:0:13021:0:(genops.c:885:class_export_put()) final put ffff9ae26b356000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788568770.244049:0:13021:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae26b356000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788568770.244072:0:13021:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788568770.244224:0:13021:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ae26b353000 00000020:01000000:1.0:1788568770.244245:0:13021:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788568770.244249:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788568770.244254:0:13021:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788568770.244259:0:13021:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9ae251de19c0) has no exports 00000100:00100000:3.0:1788568770.246923:0:12276:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9ae248953a00:12276] 4 exiting: rc = 0 00000100:00100000:3.0:1788568770.247059:0:6714:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9ae277ad4c00:6714] 3 exiting: rc = 0 00000100:00100000:1.0:1788568770.248177:0:5844:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9ae248c41800:5844] 2 exiting: rc = 0 00000100:00100000:2.0:1788568770.249782:0:5842:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9ae248c41600:5842] 0 exiting: rc = 1 00000100:00100000:2.0:1788568770.249879:0:5843:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9ae251052200:5843] 1 exiting: rc = 0 00000100:00100000:1.0:1788568770.255313:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255323:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255329:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255334:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255339:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255344:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255349:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255355:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255360:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255365:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255371:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255376:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255382:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255386:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255392:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255396:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255402:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255407:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255413:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255418:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255423:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255444:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255450:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255455:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255460:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255465:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255470:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255475:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255480:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255486:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255491:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255496:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255502:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255507:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255512:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255684:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255689:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255694:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255699:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255706:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255711:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255716:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255722:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255726:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255731:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255736:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255741:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255746:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255751:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255756:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255761:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255766:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255771:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255776:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255781:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255785:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255797:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255806:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255811:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255816:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255820:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255824:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255829:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.255843:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.271653:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9ae251052600:5845] 0 exiting: rc = 1 00000100:00100000:2.0:1788568770.271753:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9ae251052a00:5846] 1 exiting: rc = 0 00000100:00100000:1.0:1788568770.271915:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.271923:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272021:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272027:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272033:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272038:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272044:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272050:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272139:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272152:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272158:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272164:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272171:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272175:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272180:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272184:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272189:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272194:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272200:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272205:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272333:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272341:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272346:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272351:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272355:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272359:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272375:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272381:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272386:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272391:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272396:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272401:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272407:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272412:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272417:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272422:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272426:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272430:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272435:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272440:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272444:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272448:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272454:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272458:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272463:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272467:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272472:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272476:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272482:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272486:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272491:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272495:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272502:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272507:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272513:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272528:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272533:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272539:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272544:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272549:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272554:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272567:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272572:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.272577:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.273232:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9ae2464f1a00:5847] 0 exiting: rc = 1 00000100:00100000:3.0:1788568770.281752:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9ae251cec800:5848] 1 exiting: rc = 0 00000100:00100000:1.0:1788568770.289666:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.289676:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.289682:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.289688:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.289694:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.289700:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.289705:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.289711:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.289716:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.289722:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.289728:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.289733:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.289758:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.289765:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.289770:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.289776:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.289781:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.289786:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.289791:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.289796:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.289801:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.289807:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.289812:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.289818:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.289836:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.289843:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.289848:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.289853:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.289860:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.289865:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.289871:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.289876:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.289894:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.289900:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.289906:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.289911:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.289946:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.289953:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.289959:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.289976:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.289982:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.289988:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.289994:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.290000:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.290005:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.290011:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.290016:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.290022:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.290042:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.290050:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.290208:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.290218:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.290227:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.290233:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.290240:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.290247:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.290254:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.290260:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.290266:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.290272:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.290296:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.290305:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.290311:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.290318:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788568770.304738:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9ae2464e7600:5850] 1 exiting: rc = 0 00000100:00100000:1.0:1788568770.304740:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9ae2464e6a00:5849] 0 exiting: rc = 1 00000100:00100000:0.0:1788568770.309753:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311348:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311357:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311376:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311382:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311386:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311391:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311396:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311401:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311406:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311410:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311415:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311420:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311424:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311429:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311433:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311438:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311442:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311446:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311450:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311455:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311460:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311464:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311470:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311476:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311482:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311487:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311492:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311496:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311567:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311573:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311577:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311582:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311586:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311591:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311596:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311601:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311605:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311618:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311623:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311627:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311632:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311637:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311641:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311645:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311649:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311654:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311659:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311663:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311667:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311672:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311676:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311681:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311686:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311691:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311696:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311700:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311704:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311710:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311715:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311719:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311725:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311732:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.311738:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788568770.312443:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9ae2464e7000:5852] 1 exiting: rc = 0 00000100:00100000:1.0:1788568770.312649:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9ae2464e7200:5851] 0 exiting: rc = 1 00000100:00100000:0.0:1788568770.312771:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.312782:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.312792:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.312800:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.312810:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.312817:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.312860:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.312867:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.312873:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.312885:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.312890:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.312895:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.312900:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.312905:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.312911:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.312916:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.312920:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313001:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313008:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313012:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313017:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313022:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313027:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313032:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313036:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313041:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313045:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313050:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313054:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313059:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313063:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313068:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313073:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313077:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313082:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313087:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313091:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313096:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313101:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313107:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313112:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313117:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313122:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313126:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313138:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313143:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313148:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313153:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313158:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313162:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313167:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313172:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313176:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313180:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313185:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313259:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313265:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313269:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313274:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313278:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313283:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313287:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313292:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.313296:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.315849:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9ae2487e1e00:5853] 0 exiting: rc = 1 00000100:00100000:3.0:1788568770.316624:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9ae2464e7a00:5854] 1 exiting: rc = 0 00000100:00100000:0.0:1788568770.317033:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317040:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317046:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317053:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317059:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317065:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317069:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317075:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317079:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317084:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317089:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317094:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317099:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317105:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317110:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317127:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317132:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317136:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317141:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317147:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317151:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317156:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317161:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317167:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317171:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317176:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317182:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317187:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317192:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317197:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317202:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317208:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317212:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317217:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317222:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317227:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317232:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317237:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317242:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317247:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317252:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317258:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317263:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317268:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317273:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317279:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317284:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317289:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317295:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317300:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317329:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317335:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317340:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317345:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317351:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317356:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317361:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317366:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317371:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317377:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317382:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317387:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317393:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568770.317398:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788568770.318446:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9ae2487db400:5855] 0 exiting: rc = 1 00000100:00100000:0.0:1788568770.318455:0:5857:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9ae2487daa00:5857] 2 exiting: rc = 0 00000100:00100000:1.0:1788568770.318638:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9ae2487dea00:5856] 1 exiting: rc = 0 00000100:00100000:1.0:1788568770.328881:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.328892:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.328898:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.328904:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.328909:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.328916:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.328923:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.328975:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.328981:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.328987:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.328993:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329000:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329005:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329011:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329016:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329022:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329027:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329032:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329037:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329043:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329074:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329082:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329088:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329093:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329098:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329103:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329108:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329113:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329118:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329123:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329129:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329133:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329138:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329143:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329163:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329169:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329175:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329180:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329185:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329191:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329196:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329201:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329206:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329211:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329229:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329236:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329488:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329497:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329502:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329508:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329513:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329519:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329524:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329529:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329534:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329539:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329544:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329552:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329558:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329564:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329570:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329575:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329581:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568770.329586:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788568770.337037:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788568770.337050:0:13021:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788568770.337055:0:13021:0:(genops.c:885:class_export_put()) final put ffff9ae2527aa000/MDS_uuid 00000020:00000080:0.0:1788568770.337060:0:13021:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae2527aa000/MDS_uuid for MDS 00000020:01000000:0.0:1788568770.337065:0:13021:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788568770.337198:0:13021:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788568770.745501:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568771.767199:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568772.794820:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788568772.987349:0:13175:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788568773.002298:0:13175:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788568773.002346:0:13175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae27feab400/0x41e82f464b6a0d4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0d55 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568773.002360:0:13175:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae27feab400/0x41e82f464b6a0d4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0d55 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568773.002380:0:13175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae27feab400/0x41e82f464b6a0d4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x41e82f464b6a0d55 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568773.002387:0:13175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.104@tcp lock: ffff9ae27feab400/0x41e82f464b6a0d4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x41e82f464b6a0d55 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568773.002404:0:13175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788568773.002409:0:13175:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788568773.002428:0:13175:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788568773.002432:0:13175:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788568773.002437:0:13175:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788568773.002443:0:13175:0:(import.c:65:import_set_state_nolock()) ffff9ae27fd8c800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788568773.002447:0:13175:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788568773.002449:0:13175:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788568773.002452:0:13175:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788568773.003310:0:13175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae27feaa600/0x41e82f464b6a0d5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0d63 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568773.003321:0:13175:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae27feaa600/0x41e82f464b6a0d5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0d63 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568773.003327:0:13175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae27feaa600/0x41e82f464b6a0d5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x41e82f464b6a0d63 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568773.003333:0:13175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.104@tcp lock: ffff9ae27feaa600/0x41e82f464b6a0d5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x41e82f464b6a0d63 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568773.003358:0:13175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788568773.003374:0:13175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a800/0x41e82f464b6a0f93 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0f9a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568773.003380:0:13175:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a800/0x41e82f464b6a0f93 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0f9a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568773.003387:0:13175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a800/0x41e82f464b6a0f93 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x41e82f464b6a0f9a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568773.003393:0:13175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a800/0x41e82f464b6a0f93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x41e82f464b6a0f9a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568773.003402:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788568773.003567:0:13175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788568773.003572:0:13175:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788568773.003590:0:13175:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788568773.003594:0:13175:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788568773.003600:0:13175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788568773.003604:0:13175:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788568773.003608:0:13175:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9ae27bbc19c0) has no exports 00000020:00080000:1.0:1788568773.003630:0:13175:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9ae27bbc19c0) has no exports 00010000:00010000:2.0:1788568773.004753:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae27feab400/0x41e82f464b6a0d4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x41e82f464b6a0d55 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568773.004766:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feab400 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:2.0:1788568773.004770:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae27feab400/0x41e82f464b6a0d4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x41e82f464b6a0d55 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568773.004780:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae27feab400/0x41e82f464b6a0d4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x41e82f464b6a0d55 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788568773.004787:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae27feab400/0x41e82f464b6a0d4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x41e82f464b6a0d55 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788568773.004793:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788568773.004796:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788568773.004799:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788568773.004848:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae27feab400/0x41e82f464b6a0d4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x41e82f464b6a0d55 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568773.004854:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788568773.004879:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae27feab400/0x41e82f464b6a0d4e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x41e82f464b6a0d55 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568773.004886:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae27feab400/0x41e82f464b6a0d4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x41e82f464b6a0d55 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568773.004900:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788568773.004904:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae27feaa600/0x41e82f464b6a0d5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x41e82f464b6a0d63 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568773.004915:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaa600 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:2.0:1788568773.004917:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae27feaa600/0x41e82f464b6a0d5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x41e82f464b6a0d63 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568773.004942:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae27feaa600/0x41e82f464b6a0d5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x41e82f464b6a0d63 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788568773.004960:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae27feaa600/0x41e82f464b6a0d5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x41e82f464b6a0d63 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788568773.004966:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788568773.004968:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1788568773.004970:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1788568773.004988:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae27feaa600/0x41e82f464b6a0d5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x41e82f464b6a0d63 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568773.004994:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788568773.005013:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae27feaa600/0x41e82f464b6a0d5c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x41e82f464b6a0d63 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568773.005026:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae27feaa600/0x41e82f464b6a0d5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x41e82f464b6a0d63 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568773.005034:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788568773.005038:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a800/0x41e82f464b6a0f93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x41e82f464b6a0f9a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568773.005043:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7a800 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:2.0:1788568773.005045:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a800/0x41e82f464b6a0f93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x41e82f464b6a0f9a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568773.005051:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a800/0x41e82f464b6a0f93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x41e82f464b6a0f9a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788568773.005056:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a800/0x41e82f464b6a0f93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x41e82f464b6a0f9a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788568773.005061:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788568773.005063:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788568773.005065:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788568773.005082:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a800/0x41e82f464b6a0f93 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x41e82f464b6a0f9a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568773.005087:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788568773.005093:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a800/0x41e82f464b6a0f93 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x41e82f464b6a0f9a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568773.005100:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a800/0x41e82f464b6a0f93 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x41e82f464b6a0f9a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568773.005118:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568773.005120:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568773.005123:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568773.005154:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925db6b8-84bc-418c-b37a-40345c1020be:3309:1875449976280704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788568773.005218:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568773.005280:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976280832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788568773.005303:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568773.005322:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788568773.005327:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976280960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788568773.005360:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568773.005397:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976280704 00000100:00100000:2.0:1788568773.005408:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976280704 00000100:00100000:2.0:1788568773.005448:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976280832 00000100:00100000:2.0:1788568773.005451:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976280832 00000100:00100000:2.0:1788568773.005460:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976280960 00000100:00100000:2.0:1788568773.005462:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976280960 00000100:00100000:2.0:1788568773.005472:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788568773.005478:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3309:x1875449976280704:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788568773.005483:0:5827:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788568773 with bad export cookie 4749097786021644855 00000020:01000000:1.0:1788568773.006163:0:13175:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ae252ec4060 - data ffff9ae245e1b6c0/ffff9ae26f6f1800 00000020:01000000:1.0:1788568773.006296:0:13175:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ae248a9b4e0 - data ffff9ae277e08948/ffff9ae27794d400 00010000:00010000:0.0:1788568773.006690:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568773.007024:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788568773.007032:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3306:x1875449976280832:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788568773.007038:0:5829:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788568773 with bad export cookie 4749097786021644855 00000100:00100000:0.0:1788568773.007105:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3306:x1875449976280832:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (1799us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788568773.007111:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788568773.007129:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788568773.007134:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae25319e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3306:x1875449976280960:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788568773.007149:0:5829:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788568773 with bad export cookie 4749097786021644855 00000100:00100000:0.0:1788568773.007176:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae25319e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3306:x1875449976280960:12345-0@lo:103:ldlm_bl.0 Request processed in 40us (1818us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788568773.007183:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:3.0:1788568773.007417:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788568773.010049:0:3306:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.104@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788568773.010055:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9ae243de0000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788568773.010060:0:3306:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.104@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1788568773.025395:0:3306:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.104@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788568773.025401:0:3306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788568773.025409:0:3306:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ae2739f2a00 x1875449976280704/t0(0) o103->MGC192.168.206.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788568789 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568773.025437:0:3306:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ae2739f1c00 x1875449976280832/t0(0) o103->MGC192.168.206.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788568789 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568773.025446:0:3306:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ae2739f3480 x1875449976280960/t0(0) o103->MGC192.168.206.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788568789 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788568773.025455:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788568773.025457:0:3306:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788568773.025459:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788568773.025462:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9ae243de0000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788568773.025467:0:3306:0:(import.c:545:import_select_connection()) MGC192.168.206.104@tcp: connect to NID 0@lo last attempt 171 00000100:00080000:3.0:1788568773.025475:0:3306:0:(import.c:665:import_select_connection()) MGC192.168.206.104@tcp: import ffff9ae243de0000 using connection 192.168.206.104@tcp/0@lo 00000100:00100000:0.0:1788568773.025570:0:3306:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae27b567480 x1875449976281088/t0(0) o250->MGC192.168.206.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788568773.025574:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925db6b8-84bc-418c-b37a-40345c1020be:3309:1875449976280704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788568773.025635:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b567480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:925db6b8-84bc-418c-b37a-40345c1020be:3305:1875449976281088:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:1.0:1788568773.025678:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875449976281088 offset 0 length 520: 4 00000100:00100000:0.0:1788568773.025737:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976280832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788568773.025750:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925db6b8-84bc-418c-b37a-40345c1020be:3306:1875449976280960:0@lo:103:ldlm_bl.0 00000400:00000100:2.0:1788568773.031206:0:5827:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1875449976280704 offset 224 length 224: 4 00000100:00100000:2.0:1788568773.031231:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3309:x1875449976280704:12345-0@lo:103:ldlm_bl.0 Request processed in 25751us (26012us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788568773.031241:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00100000:10000000:0.0:1788568773.046533:0:13175:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788568773.060251:0:13175:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x41e82f464b6a0b6b 00000020:00000080:2.0:1788568773.060261:0:13175:0:(genops.c:885:class_export_put()) final put ffff9ae277912000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788568773.060282:0:13175:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ae27bf74800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788568773.060286:0:13175:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae27bf74800 2 00000020:01000004:2.0:1788568773.060300:0:13175:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ae27bf74800 from lustre-OST0000 00000020:00000080:2.0:1788568773.060322:0:13175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788568773.060332:0:13175:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788568773.060335:0:13175:0:(genops.c:885:class_export_put()) final put ffff9ae277910800/lustre-OST0000_UUID 00000020:00000080:2.0:1788568773.060338:0:13175:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae277910800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788568773.060345:0:13175:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788568773.060381:0:13175:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788568773.060386:0:13175:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788568773.060389:0:13175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788568773.060394:0:13175:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788568773.060400:0:13175:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9ae277b99800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788568773.060405:0:13175:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff9ae281c04d40) has exports, disconnecting them 00000020:00080000:2.0:1788568773.060409:0:13175:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9ae277b99800), last request at 1788568556 00000020:00000080:2.0:1788568773.060413:0:13175:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x41e82f464b6a0b95 00000020:00080000:2.0:1788568773.060424:0:13175:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ae277b99800): rc 0 00000020:00000080:2.0:1788568773.060429:0:13175:0:(genops.c:885:class_export_put()) final put ffff9ae277b99800/lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788568773.061096:0:13175:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788568773.061101:0:13175:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788568773.061105:0:13175:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788568773.061111:0:13175:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788568773.061219:0:13175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788568773.061225:0:13175:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1788568773.061228:0:13175:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae27bf74800 1 00000020:00000080:2.0:1788568773.061232:0:13175:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x41e82f464b6a0b25 00000020:00000080:2.0:1788568773.061236:0:13175:0:(genops.c:885:class_export_put()) final put ffff9ae27bf77800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788568773.061241:0:13175:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788568773.061245:0:13175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788568773.061247:0:13175:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788568773.061250:0:13175:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9ae248ddcd40) has no exports 00000020:00000080:0.0:1788568773.061355:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae277912000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788568773.061366:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae277b99800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788568773.061371:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae27fd8c800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788568773.061376:0:37:0:(genops.c:885:class_export_put()) final put ffff9ae277b97000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788568773.061378:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae277b97000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788568773.061384:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788568773.061425:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae27bf77800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788568773.074224:0:13175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788568773.074238:0:13175:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788568773.074244:0:13175:0:(genops.c:885:class_export_put()) final put ffff9ae27bf76800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788568773.074248:0:13175:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae27bf76800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788568773.074255:0:13175:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788568773.074419:0:13175:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ae27bf74000 00000020:02000400:0.0:1788568773.074474:0:13175:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788568773.820173:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788568774.135685:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 925db6b8-84bc-418c-b37a-40345c1020be->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788568774.135695:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 925db6b8-84bc-418c-b37a-40345c1020be->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788568774.135699:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788568774.135719:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788568774.135723:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ae27ff27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788568774.135731:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 403 00000100:00080000:1.0:1788568774.135737:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788568774.135744:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ae27ff27000 using connection 192.168.206.104@tcp/0@lo 00000100:00100000:1.0:1788568774.135778:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae273aa1880 x1875449976281216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788568774.135974:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1875449976281216:0@lo:38:kworker.0 00000400:00000100:2.0:1788568774.136044:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875449976281216 offset 0 length 520: 4 00010000:00010000:1.0:1788568774.844901:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788568775.631733:0:13325:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788568775.651858:0:13325:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788568775.652064:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a000/0x41e82f464b6a0d32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0d39 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568775.652080:0:13325:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a000/0x41e82f464b6a0d32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0d39 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568775.652087:0:13325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a000/0x41e82f464b6a0d32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x41e82f464b6a0d39 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568775.652093:0:13325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a000/0x41e82f464b6a0d32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x41e82f464b6a0d39 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568775.652146:0:13325:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788568775.652151:0:13325:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788568775.652177:0:13325:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788568775.652198:0:13325:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ae273aa1880 x1875449976281216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788568789 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568775.652218:0:13325:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788568775.652225:0:13325:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788568775.652231:0:13325:0:(import.c:65:import_set_state_nolock()) ffff9ae27ff27000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788568775.652235:0:13325:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788568775.652239:0:13325:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ae273aa1880 x1875449976281216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788568789 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568775.652246:0:13325:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788568775.652249:0:13325:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00000100:00100000:3.0:1788568775.652711:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1875449976281216:0@lo:38:kworker.0 00010000:00010000:2.0:1788568775.653624:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae27feaac00/0x41e82f464b6a0d40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0d47 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568775.653650:0:13325:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae27feaac00/0x41e82f464b6a0d40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0d47 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568775.653658:0:13325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae27feaac00/0x41e82f464b6a0d40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x41e82f464b6a0d47 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568775.653665:0:13325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.104@tcp lock: ffff9ae27feaac00/0x41e82f464b6a0d40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x41e82f464b6a0d47 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568775.656402:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788568775.656415:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a000/0x41e82f464b6a0d32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x41e82f464b6a0d39 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568775.656439:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7a000 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:0.0:1788568775.656443:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a000/0x41e82f464b6a0d32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x41e82f464b6a0d39 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568775.656453:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a000/0x41e82f464b6a0d32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x41e82f464b6a0d39 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788568775.656460:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a000/0x41e82f464b6a0d32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x41e82f464b6a0d39 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568775.656466:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788568775.656469:0:8454:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788568775.656472:0:8454:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788568775.656485:0:8454:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ae243de0000 00010000:00010000:0.0:1788568775.656489:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a000/0x41e82f464b6a0d32 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x41e82f464b6a0d39 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568775.656495:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a000/0x41e82f464b6a0d32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x41e82f464b6a0d39 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568775.656509:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788568775.656513:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae27feaac00/0x41e82f464b6a0d40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x41e82f464b6a0d47 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568775.656518:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaac00 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:0.0:1788568775.656521:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae27feaac00/0x41e82f464b6a0d40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x41e82f464b6a0d47 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568775.656527:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae27feaac00/0x41e82f464b6a0d40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x41e82f464b6a0d47 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788568775.656540:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae27feaac00/0x41e82f464b6a0d40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x41e82f464b6a0d47 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568775.656545:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788568775.656547:0:8454:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1788568775.656551:0:8454:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ae243de0000 00010000:00010000:0.0:1788568775.656554:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae27feaac00/0x41e82f464b6a0d40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x41e82f464b6a0d47 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568775.656561:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568775.656562:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568775.656564:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568775.657964:0:13325:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788568775.657976:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae27feaac00/0x41e82f464b6a0d40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x41e82f464b6a0d47 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568775.657999:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae282045600/0x41e82f464b6a0f85 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a0f8c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568775.658007:0:13325:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae282045600/0x41e82f464b6a0f85 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a0f8c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568775.658013:0:13325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae282045600/0x41e82f464b6a0f85 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x41e82f464b6a0f8c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568775.658019:0:13325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.104@tcp lock: ffff9ae282045600/0x41e82f464b6a0f85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x41e82f464b6a0f8c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568775.658038:0:13325:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788568775.658042:0:13325:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1788568775.658048:0:13325:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788568775.658079:0:13325:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788568775.658094:0:13325:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788568775.658099:0:13325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788568775.658104:0:13325:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788568775.658107:0:13325:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9ae27bbc3380) has no exports 00000020:00080000:2.0:1788568775.658131:0:13325:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9ae27bbc3380) has no exports 00000020:01000000:2.0:1788568775.659645:0:13325:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ae251c44600 - data ffff9ae270b926c0/ffff9ae26f68a800 00000020:01000000:2.0:1788568775.659794:0:13325:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ae2779bb8a0 - data ffff9ae245ffd798/ffff9ae277b3b400 00010000:00010000:3.0:1788568775.660173:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788568775.660182:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae282045600/0x41e82f464b6a0f85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x41e82f464b6a0f8c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568775.660205:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae282045600 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:3.0:1788568775.660209:0:8455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae282045600/0x41e82f464b6a0f85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x41e82f464b6a0f8c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568775.660218:0:8455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae282045600/0x41e82f464b6a0f85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x41e82f464b6a0f8c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788568775.660225:0:8455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae282045600/0x41e82f464b6a0f85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x41e82f464b6a0f8c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788568775.660230:0:8455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788568775.660232:0:8455:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788568775.660235:0:8455:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788568775.660249:0:8455:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ae243de0000 00010000:00010000:3.0:1788568775.660252:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae282045600/0x41e82f464b6a0f85 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x41e82f464b6a0f8c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568775.660259:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae282045600/0x41e82f464b6a0f85 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x41e82f464b6a0f8c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568775.660273:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568775.660275:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568775.660277:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568775.660417:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788568775.689534:0:13325:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788568775.730212:0:13325:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x41e82f464b6a0c36 00000020:00000080:2.0:1788568775.730222:0:13325:0:(genops.c:885:class_export_put()) final put ffff9ae26f6fe800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788568775.730248:0:13325:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ae277b92800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788568775.730252:0:13325:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae277b92800 2 00000020:01000004:2.0:1788568775.730255:0:13325:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ae277b92800 from lustre-OST0001 00000020:00000080:1.0:1788568775.730284:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae26f6fe800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788568775.730287:0:13325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788568775.730304:0:13325:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788568775.730310:0:13325:0:(genops.c:885:class_export_put()) final put ffff9ae26f6fb000/lustre-OST0001_UUID 00000020:00000080:2.0:1788568775.730315:0:13325:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae26f6fb000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788568775.730327:0:13325:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788568775.730438:0:13325:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 925db6b8-84bc-418c-b37a-40345c1020be->MGS 00010000:00010000:2.0:1788568775.730453:0:13325:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b400/0x41e82f464b6a0b48 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x41e82f464b6a0b4f expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788568775.730466:0:13325:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b400/0x41e82f464b6a0b48 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x41e82f464b6a0b4f expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788568775.730472:0:13325:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788568775.730474:0:13325:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788568775.730477:0:13325:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788568775.730496:0:13325:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ae243de0000 00010000:00010000:2.0:1788568775.730499:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b400/0x41e82f464b6a0b48 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x41e82f464b6a0b4f expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568775.730514:0:13325:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae2429dfa00/0x41e82f464b6a0d86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x41e82f464b6a0d8d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788568775.730532:0:13325:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae2429dfa00/0x41e82f464b6a0d86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x41e82f464b6a0d8d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788568775.730537:0:13325:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788568775.730540:0:13325:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788568775.730541:0:13325:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788568775.730558:0:13325:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ae243de0000 00010000:00010000:2.0:1788568775.730561:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae2429dfa00/0x41e82f464b6a0d86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x41e82f464b6a0d8d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788568775.730577:0:13325:0:(import.c:65:import_set_state_nolock()) ffff9ae243de0000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788568775.730581:0:13325:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788568775.730583:0:13325:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788568775.730585:0:13325:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788568775.730590:0:13325:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788568775.730601:0:13325:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ae27b567480 x1875449976281088/t0(0) o250->MGC192.168.206.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788568783 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788568775.730621:0:13325:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788568775.730623:0:13325:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00000100:00100000:3.0:1788568775.730856:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b567480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:925db6b8-84bc-418c-b37a-40345c1020be:3305:1875449976281088:0@lo:250:ptlrpcd_00_00.0 10000000:01000000:2.0:1788568775.730916:0:13325:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788568775.730972:0:13325:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x41e82f464b6a0a29 00000020:00000080:2.0:1788568775.730978:0:13325:0:(genops.c:885:class_export_put()) final put ffff9ae2527aa800/925db6b8-84bc-418c-b37a-40345c1020be 00000020:01000000:2.0:1788568775.730986:0:13325:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.104@tcp (flags='') 00000020:00000080:2.0:1788568775.730991:0:13325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788568775.730995:0:13325:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.104@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788568775.730999:0:13325:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9ae26b2dcd40) has no exports 00000020:00000080:1.0:1788568775.731072:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae2527aa800/925db6b8-84bc-418c-b37a-40345c1020be for MGC192.168.206.104@tcp 10000000:01000000:3.0:1788568775.731467:0:5838:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788568775.732889:0:13325:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.104@tcp: client import never connected 00000100:00080000:2.0:1788568775.732897:0:13325:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788568775.732902:0:13325:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788568775.732908:0:13325:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788568775.732963:0:13325:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788568775.733030:0:13325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788568775.733040:0:13325:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.104@tcp (uuid 925db6b8-84bc-418c-b37a-40345c1020be) 00000020:01000000:2.0:1788568775.733059:0:13325:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788568775.733065:0:13325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788568775.733071:0:13325:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788568775.733079:0:13325:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9ae277b65800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788568775.733086:0:13325:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9ae248dd8000) has exports, disconnecting them 00000020:00080000:2.0:1788568775.733091:0:13325:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9ae277b65800), last request at 1788568574 00000020:00000080:2.0:1788568775.733097:0:13325:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x41e82f464b6a0c60 00000020:00080000:2.0:1788568775.733118:0:13325:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ae277b65800): rc 0 00000020:00000080:2.0:1788568775.733124:0:13325:0:(genops.c:885:class_export_put()) final put ffff9ae277b65800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788568775.733365:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae243de0000 for MGC192.168.206.104@tcp 00000020:00000080:1.0:1788568775.733381:0:37:0:(genops.c:885:class_export_put()) final put ffff9ae26b356800/925db6b8-84bc-418c-b37a-40345c1020be 00000020:00000080:1.0:1788568775.733384:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae26b356800/925db6b8-84bc-418c-b37a-40345c1020be for MGC192.168.206.104@tcp 00000020:01000000:1.0:1788568775.733391:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.104@tcp (925db6b8-84bc-418c-b37a-40345c1020be) 00000020:00000080:1.0:1788568775.733699:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae277b65800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1788568775.734400:0:13325:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788568775.734413:0:13325:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788568775.734429:0:13325:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788568775.734436:0:13325:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788568775.734489:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae27ff27000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1788568775.734511:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788568775.734688:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1788568775.734819:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:1.0:1788568775.734919:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:3.0:1788568775.735320:0:6704:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9ae244765800:6704] 2 exiting: rc = 0 00000100:00100000:1.0:1788568775.735398:0:5826:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9ae245435600:5826] 1 exiting: rc = 0 00000100:00100000:1.0:1788568775.735472:0:5825:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9ae251c07e00:5825] 0 exiting: rc = 1 00000100:00100000:3.0:1788568775.735543:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.735755:0:6705:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9ae277b49c00:6705] 3 exiting: rc = 0 00000100:00100000:1.0:1788568775.735832:0:5829:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9ae250a2f400:5829] 2 exiting: rc = 0 00000100:00100000:0.0:1788568775.736878:0:5828:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9ae245434a00:5828] 1 exiting: rc = 0 00000100:00100000:3.0:1788568775.741057:0:5827:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9ae245434c00:5827] 0 exiting: rc = 1 00000100:00100000:1.0:1788568775.742619:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742629:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742634:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742640:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742672:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742678:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742683:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742688:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742694:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742699:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742705:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742712:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742717:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742724:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742729:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742735:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742741:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742746:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742751:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742757:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742762:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742767:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742772:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742777:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742782:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742787:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742792:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742797:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742803:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742808:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742813:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742818:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742823:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742828:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742833:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742838:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742843:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742848:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742853:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742864:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742869:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742873:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742878:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742884:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742889:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742893:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742898:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742902:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742907:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742912:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742917:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742921:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742951:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742957:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742962:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742967:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742972:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742977:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742982:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742987:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742992:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.742996:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.743001:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.743005:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788568775.745070:0:13325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788568775.745079:0:13325:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788568775.745085:0:13325:0:(genops.c:885:class_export_put()) final put ffff9ae27ff20800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788568775.745089:0:13325:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae27ff20800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788568775.745094:0:13325:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1788568775.745135:0:13325:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae277b92800 1 00000020:00000080:1.0:1788568775.745141:0:13325:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x41e82f464b6a0c05 00000020:00000080:1.0:1788568775.745146:0:13325:0:(genops.c:885:class_export_put()) final put ffff9ae277b66800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788568775.746413:0:13325:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788568775.746429:0:13325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788568775.746436:0:13325:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788568775.746440:0:13325:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9ae248ddb380) has no exports 00000020:00000080:3.0:1788568775.748285:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae277b66800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788568775.777402:0:13325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788568775.777819:0:13325:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788568775.777826:0:13325:0:(genops.c:885:class_export_put()) final put ffff9ae266969000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788568775.777830:0:13325:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae266969000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788568775.777842:0:13325:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788568775.778042:0:13325:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ae277b95800 00000020:01000000:1.0:1788568775.778061:0:13325:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788568775.778065:0:13325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788568775.778070:0:13325:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788568775.778073:0:13325:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9ae248dd99c0) has no exports 00000020:00000080:1.0:1788568775.778102:0:13325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788568775.778108:0:13325:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788568775.778111:0:13325:0:(genops.c:885:class_export_put()) final put ffff9ae27bf70000/OSS_uuid 00000020:00000080:1.0:1788568775.778113:0:13325:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae27bf70000/OSS_uuid for OSS 00000020:01000000:1.0:1788568775.778117:0:13325:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1788568775.778142:0:5837:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788568775.778316:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9ae2669b5600:6688] 0 exiting: rc = 1 00000100:00100000:1.0:1788568775.780455:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9ae26f822c00:6691] 2 exiting: rc = 0 00000100:00100000:2.0:1788568775.781396:0:8111:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9ae24895a600:8111] 3 exiting: rc = 0 00000100:00100000:1.0:1788568775.782038:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9ae2817a7e00:6690] 1 exiting: rc = 0 00000100:00100000:1.0:1788568775.782243:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.782258:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.782270:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.782286:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.782300:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.782308:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.782321:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.782329:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.782337:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.782343:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.782348:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.782376:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.782387:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.782397:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.782408:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.782420:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.782430:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.782439:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.782446:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.782455:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.782469:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.782479:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.782489:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.782511:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.782521:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.782531:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.782542:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.782554:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.782565:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.782576:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.782590:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.782603:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.782614:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.782628:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.782643:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.782655:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.784302:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.784318:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.784324:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.784330:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.784336:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.784345:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.784355:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.784362:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.784368:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.784384:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.784413:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.784420:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.784426:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.784431:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.784436:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.784442:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.784447:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.784453:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.784458:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.784467:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.784475:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.784490:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.784504:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.784517:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.784534:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.784544:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.784556:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.784577:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.785791:0:6692:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9ae2817a6800:6692] 0 exiting: rc = 1 00000100:00100000:2.0:1788568775.787470:0:6693:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9ae26f822200:6693] 1 exiting: rc = 0 00000100:00100000:1.0:1788568775.787889:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.787904:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.787916:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.788513:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.788525:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.788532:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.788537:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.788543:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.788552:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.788565:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.788572:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.788580:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.788589:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.788597:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.788605:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.788613:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.788640:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.788653:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.788773:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.788790:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.788802:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.788811:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.788821:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.788831:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.788842:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.788856:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.788868:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.788883:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.788895:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.788910:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.789074:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.789095:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.789108:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.789123:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.789137:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.789151:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.789176:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.789188:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.789194:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.789201:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.789206:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.789212:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.789217:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.789222:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.789227:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.789232:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.789238:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.789243:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.789249:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.789254:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.789259:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.789276:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.789281:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.789287:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.789293:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.789299:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.789304:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.789311:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.789316:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.789321:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.789327:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.789333:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.789339:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.789344:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.800444:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9ae2669b4200:6694] 0 exiting: rc = 1 00000100:00100000:3.0:1788568775.802282:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9ae2669b5e00:6695] 1 exiting: rc = 0 00000100:00100000:2.0:1788568775.803462:0:11980:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff9ae248dbfc00:11980] 3 exiting: rc = 0 00000100:00100000:0.0:1788568775.804424:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9ae2669b5c00:6696] 2 exiting: rc = 0 00000100:00100000:3.0:1788568775.808514:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.808527:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.808533:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.808538:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.808544:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.808550:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.808555:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.808562:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.808593:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.808606:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.808613:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.808618:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.808623:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.808629:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.808635:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.808641:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.808647:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.808653:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809494:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809502:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809509:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809514:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809519:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809525:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809541:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809546:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809552:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809558:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809563:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809567:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809574:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809580:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809602:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809608:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809614:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809620:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809626:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809631:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809636:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809642:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809647:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809653:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809659:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809676:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809681:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809687:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809692:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809698:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809703:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809708:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809714:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809718:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809723:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809728:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809733:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809738:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809758:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809764:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809769:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809779:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809784:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809788:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809794:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788568775.809799:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788568775.830096:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9ae281768400:6698] 1 exiting: rc = 0 00000100:00100000:2.0:1788568775.830419:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9ae252613400:6697] 0 exiting: rc = 1 00000100:00100000:1.0:1788568775.830676:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830687:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830693:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830699:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830705:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830710:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830717:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830723:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830729:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830735:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830741:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830747:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830753:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830759:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830766:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830772:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830777:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830782:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830788:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830794:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830800:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830804:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830825:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830831:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830835:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830840:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830845:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830851:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830856:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830862:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830867:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830872:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830878:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830883:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830889:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830894:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830901:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830906:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830911:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830916:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830921:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830972:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830978:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830983:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830988:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.830994:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.831000:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.831006:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.831037:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.831044:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.831050:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.831055:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.831060:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.831064:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.831069:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.831075:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.831080:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.831092:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.831097:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.831102:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.831108:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.831112:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.831117:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.831121:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.832518:0:6699:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9ae250b23800:6699] 0 exiting: rc = 1 00000100:00100000:0.0:1788568775.837577:0:6700:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9ae252612a00:6700] 1 exiting: rc = 0 00000100:00100000:1.0:1788568775.838065:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838271:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838283:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838290:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838296:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838304:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838311:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838319:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838331:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838337:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838359:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838367:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838373:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838379:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838385:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838391:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838396:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838402:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838409:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838415:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838422:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838427:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838453:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838461:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838468:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838474:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838481:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838504:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838512:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838518:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838526:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838532:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838539:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838547:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838570:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838578:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838584:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838590:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838596:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838602:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838609:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838615:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838621:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838628:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838634:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838640:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838665:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838673:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838679:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838686:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838692:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838699:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838705:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838714:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838721:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838727:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838734:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838748:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838770:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838778:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838785:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838791:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838820:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788568775.838829:0:13325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788568775.859646:0:13325:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788568790.967519:0:13941:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg604-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788568798.327395:0:14403:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788568798.327401:0:14403:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788568798.327505:0:14403:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ae26f783800 00000020:01000004:2.0:1788568798.327520:0:14403:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788568798.327528:0:14403:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788568798.327553:0:14403:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9ae248dd99c0) 00000020:00000080:2.0:1788568798.327569:0:14403:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788568798.360744:0:14403:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788568798.366969:0:14403:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1788568798.371003:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 401: rc = 0 00100000:10000000:3.0:1788568798.372887:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 401: rc = 0 00100000:10000000:3.0:1788568798.373130:0:14403:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788568798.373205:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 401: rc = 0 00100000:10000000:3.0:1788568798.374729:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 401: rc = 0 00100000:10000000:3.0:1788568798.374921:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 401: rc = 0 00100000:10000000:3.0:1788568798.375040:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 401: rc = 0 00100000:10000000:3.0:1788568798.376868:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 513: rc = 0 00100000:10000000:3.0:1788568798.381362:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 406: rc = 0 00100000:10000000:3.0:1788568798.381512:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 406: rc = 0 00100000:10000000:3.0:1788568798.383360:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 233: rc = 0 00100000:10000000:3.0:1788568798.384386:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 233: rc = 0 00100000:10000000:2.0:1788568798.391374:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 233: rc = 0 00100000:10000000:2.0:1788568798.394982:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 233: rc = 0 00100000:10000000:2.0:1788568798.395273:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 233: rc = 0 00100000:10000000:2.0:1788568798.395520:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 233: rc = 0 00100000:10000000:2.0:1788568798.397107:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 233: rc = 0 00100000:10000000:2.0:1788568798.397372:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 233: rc = 0 00100000:10000000:2.0:1788568798.398013:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 233: rc = 0 00100000:10000000:2.0:1788568798.398337:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 233: rc = 0 00100000:10000000:2.0:1788568798.399228:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 233: rc = 0 00100000:10000000:2.0:1788568798.399528:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 233: rc = 0 00100000:10000000:2.0:1788568798.400330:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 234: rc = 0 00100000:10000000:2.0:1788568798.400825:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 234: rc = 0 00100000:10000000:2.0:1788568798.401089:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 234: rc = 0 00100000:10000000:2.0:1788568798.401795:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 234: rc = 0 00100000:10000000:2.0:1788568798.402071:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 234: rc = 0 00100000:10000000:2.0:1788568798.402646:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 234: rc = 0 00100000:10000000:2.0:1788568798.403082:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 234: rc = 0 00100000:10000000:2.0:1788568798.403509:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 234: rc = 0 00100000:10000000:2.0:1788568798.403920:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 234: rc = 0 00100000:10000000:2.0:1788568798.404206:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 234: rc = 0 00100000:10000000:2.0:1788568798.404663:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 234: rc = 0 00100000:10000000:2.0:1788568798.405145:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 234: rc = 0 00100000:10000000:2.0:1788568798.405641:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 234: rc = 0 00100000:10000000:2.0:1788568798.406011:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 234: rc = 0 00100000:10000000:2.0:1788568798.406307:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 234: rc = 0 00100000:10000000:2.0:1788568798.406673:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 234: rc = 0 00100000:10000000:2.0:1788568798.407127:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 234: rc = 0 00100000:10000000:2.0:1788568798.407630:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 234: rc = 0 00100000:10000000:2.0:1788568798.408003:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 234: rc = 0 00100000:10000000:2.0:1788568798.408428:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 234: rc = 0 00100000:10000000:2.0:1788568798.408870:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 234: rc = 0 00100000:10000000:2.0:1788568798.409174:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 234: rc = 0 00100000:10000000:2.0:1788568798.409954:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 234: rc = 0 00100000:10000000:2.0:1788568798.410218:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 234: rc = 0 00100000:10000000:2.0:1788568798.411055:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 234: rc = 0 00100000:10000000:2.0:1788568798.411398:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 234: rc = 0 00100000:10000000:2.0:1788568798.411888:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 234: rc = 0 00100000:10000000:2.0:1788568798.412154:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 234: rc = 0 00100000:10000000:2.0:1788568798.412654:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 234: rc = 0 00100000:10000000:2.0:1788568798.413067:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 234: rc = 0 00100000:10000000:2.0:1788568798.413606:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 234: rc = 0 00100000:10000000:2.0:1788568798.414063:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 234: rc = 0 00100000:10000000:2.0:1788568798.414691:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 422: rc = 0 00100000:10000000:2.0:1788568798.415890:0:14403:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1788568798.416088:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 94: rc = 0 00100000:10000000:2.0:1788568798.416370:0:14403:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1788568798.416630:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 94: rc = 0 00100000:10000000:2.0:1788568798.417069:0:14403:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1788568798.417147:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 94: rc = 0 00100000:10000000:2.0:1788568798.418204:0:14403:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1788568798.418299:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 407: rc = 0 00100000:10000000:2.0:1788568798.418808:0:14403:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788568798.418904:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 407: rc = 0 00100000:10000000:2.0:1788568798.419148:0:14403:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788568798.419367:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 407: rc = 0 00000020:00000080:2.0:1788568798.419831:0:14403:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788568798.419839:0:14403:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788568798.419849:0:14403:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x41e82f464b6a1d2a 00000020:01000004:2.0:1788568798.419856:0:14403:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788568798.419861:0:14403:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788568798.419872:0:14403:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ae26f783800 from MGS 00000020:01000004:2.0:1788568798.419876:0:14403:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788568798.419885:0:14403:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9ae248ddb380) 00000020:00000080:2.0:1788568798.419896:0:14403:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788568798.419973:0:14403:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ae26f783800 from MGS, refs=2 00080000:01000000:2.0:1788568798.419977:0:14403:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788568798.419982:0:14403:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x41e82f464b6a1d38 00000100:00100000:2.0:1788568798.420073:0:14403:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788568798.420202:0:14403:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788568798.420208:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788568798.421238:0:14403:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788568798.421248:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788568798.422863:0:14403:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788568798.423349:0:14403:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788568798.423356:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788568798.424036:0:14403:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788568798.424044:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788568798.424377:0:14403:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788568798.424384:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788568798.425173:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568798.425176:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568798.425178:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568798.426433:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568798.426438:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568798.426440:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568798.427355:0:14403:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788568798.430346:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788568798.459096:0:14403:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788568798.459120:0:14403:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788568798.459123:0:14403:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1788568798.466247:0:14412:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788568798.467855:0:14403:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788568798.468011:0:14403:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788568798.469136:0:14403:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788568798.473177:0:14403:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788568798.473377:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788568798.473384:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788568798.475090:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788568798.475100:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788568798.476655:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788568798.476665:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788568798.477424:0:14403:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788568798.477444:0:14403:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.104@tcp' 00000020:01000004:3.0:1788568798.477445:0:14403:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788568798.477473:0:14403:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.104@tcp (typ=mgc) 00000020:00000080:3.0:1788568798.477488:0:14403:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.104@tcp (ffff9ae26fb799c0) 00000020:00000080:3.0:1788568798.477506:0:14403:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788568798.477598:0:14403:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae1432f4800@MGC192.168.206.104@tcp: add connection 192.168.206.104@tcp at head 00010000:00010000:3.0:1788568798.477756:0:14403:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.104@tcp-0 is initialized 00000040:01000000:3.0:1788568798.477762:0:14403:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.104@tcp ctxt 1 is initialized 10000000:01000000:2.0:1788568798.479575:0:14418:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000100:00080000:0.0:1788568798.479668:0:14417:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:3.0:1788568798.480224:0:14403:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.104@tcp (uuid bbee97af-a6b0-4265-8c9f-26b826a76798) 00000020:00000080:3.0:1788568798.480248:0:14403:0:(genops.c:1385:class_connect()) connect: client bbee97af-a6b0-4265-8c9f-26b826a76798, cookie 0x41e82f464b6a1d46 00000100:00080000:3.0:1788568798.480261:0:14403:0:(import.c:545:import_select_connection()) MGC192.168.206.104@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788568798.480268:0:14403:0:(import.c:665:import_select_connection()) MGC192.168.206.104@tcp: import ffff9ae1432f4800 using connection 192.168.206.104@tcp/0@lo 00000100:00100000:3.0:1788568798.480301:0:14403:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae273b65880 x1875449976281344/t0(0) o250->MGC192.168.206.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788568798.480334:0:14403:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import bbee97af-a6b0-4265-8c9f-26b826a76798->MGS 00000020:01000004:3.0:1788568798.480351:0:14403:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788568798.480355:0:14403:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788568798.480368:0:14403:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9ae26fb7b380) 00000020:00000080:3.0:1788568798.480379:0:14403:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788568798.481126:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273b65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bbee97af-a6b0-4265-8c9f-26b826a76798:3305:1875449976281344:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788568798.481190:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568798.481323:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976281344 00000100:00100000:0.0:1788568798.481330:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976281344 00000100:00100000:0.0:1788568798.481358:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788568798.481373:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277a86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3305:x1875449976281344:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788568798.481395:0:14414:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from bbee97af-a6b0-4265-8c9f-26b826a76798@0@lo t0 exp 0000000000000000 cur 432 last 0 00000020:00000080:0.0:1788568798.481417:0:14414:0:(genops.c:1385:class_connect()) connect: client bbee97af-a6b0-4265-8c9f-26b826a76798, cookie 0x41e82f464b6a1d54 00000100:00080000:0.0:1788568798.481525:0:14414:0:(import.c:65:import_set_state_nolock()) ffff9ae26b353000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788568798.485956:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277a86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+5:3305:x1875449976281344:12345-0@lo:250:mount.lustre.0 Request processed in 4572us (4755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568798.485974:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788568798.489717:0:3305:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.104@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788568798.489738:0:3305:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.206.104@tcp: connect to target with instance 0 00000100:00080000:3.0:1788568798.489747:0:3305:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.206.104@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788568798.489753:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788568798.489759:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ae1432f4800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788568798.489773:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788568798.489787:0:3305:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788568798.489796:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273b65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bbee97af-a6b0-4265-8c9f-26b826a76798:3305:1875449976281344:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788568798.499652:0:14403:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788568798.500238:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788568798.500246:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788568798.505017:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788568798.505030:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788568798.506226:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788568798.506235:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788568798.507412:0:14403:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788568798.511503:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788568798.511516:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788568798.513962:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788568798.513979:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788568798.556748:0:14403:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788568798.557234:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788568798.557241:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788568798.558265:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788568798.558274:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788568798.560319:0:14403:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788568798.560484:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788568798.560490:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788568798.561079:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788568798.561087:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788568798.561612:0:14403:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788568798.561757:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788568798.561762:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788568798.562610:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788568798.562618:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788568798.563252:0:14403:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788568798.563396:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788568798.563401:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788568798.564065:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788568798.564071:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788568798.589756:0:14403:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788568798.590012:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788568798.590019:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788568798.594197:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788568798.594216:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788568798.597047:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788568798.597064:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788568798.600197:0:14403:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788568798.600222:0:14403:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788568798.600228:0:14403:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.104@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788568798.600347:0:14403:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.104@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788568798.600377:0:14403:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.104@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788568798.600382:0:14403:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788568798.600383:0:14403:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788568798.600385:0:14403:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788568798.600386:0:14403:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788568798.600387:0:14403:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788568798.600388:0:14403:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788568798.600390:0:14403:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788568798.600391:0:14403:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788568798.600393:0:14403:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788568798.600394:0:14403:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788568798.600397:0:14403:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788568798.600399:0:14403:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788568798.600400:0:14403:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788568798.600401:0:14403:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788568798.600402:0:14403:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788568798.600403:0:14403:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788568798.600404:0:14403:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788568798.600405:0:14403:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788568798.600406:0:14403:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788568798.600407:0:14403:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788568798.600408:0:14403:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788568798.600431:0:14403:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788568798.600449:0:14403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:14403:1875449976281472:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788568798.600523:0:14403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568798.600659:0:14403:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae25265bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788568798.600728:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976281472 00000100:00100000:0.0:1788568798.600735:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976281472 00000100:00100000:0.0:1788568798.600780:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788568798.600789:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277a86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+5:14403:x1875449976281472:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788568798.600853:0:14416:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788568798.600855:0:14416:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788568798.600859:0:14416:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788568798.601895:0:14437:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788568798.602371:0:14416:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1788568798.604502:0:14438:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788568798.604510:0:14438:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788568798.604512:0:14438:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788568798.604625:0:14438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1788568798.605359:0:14416:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788568798.605370:0:14416:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788568798.615503:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277a86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+5:14403:x1875449976281472:12345-0@lo:253:mount.lustre.0 Request processed in 14707us (14971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568798.615521:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788568798.615659:0:14403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:14403:1875449976281472:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788568798.615675:0:14403:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788568798.615679:0:14403:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788568798.615680:0:14403:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788568798.615682:0:14403:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788568798.615683:0:14403:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788568798.615684:0:14403:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788568798.615685:0:14403:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788568798.615686:0:14403:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788568798.615689:0:14403:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788568798.615690:0:14403:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788568798.615692:0:14403:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788568798.615710:0:14403:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ae26f783800 from lustre-MDT0000 10000000:01000000:1.0:1788568798.615736:0:14403:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788568798.615739:0:14403:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788568798.615743:0:14403:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9ae26fb799c0 10000000:01000000:1.0:1788568798.615748:0:14403:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788568798.615755:0:14403:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ae26fb799c0 from 1 10000000:01000000:1.0:1788568798.615758:0:14403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788568798.615790:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae273b2ce00/0x41e82f464b6a1d5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568798.616154:0:14403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae273b2ce00/0x41e82f464b6a1d5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568798.616165:0:14403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae273b2ce00/0x41e82f464b6a1d5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568798.616185:0:14403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:14403:1875449976281600:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788568798.616237:0:14403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568798.616304:0:14403:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae242d88d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788568798.616346:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976281600 00000100:00100000:0.0:1788568798.616353:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976281600 00000100:00100000:0.0:1788568798.616422:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788568798.616431:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+5:14403:x1875449976281600:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788568798.616443:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568798.616459:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae27feaba00/0x41e82f464b6a1d62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a1d5b expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568798.616478:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae27feaba00/0x41e82f464b6a1d62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a1d5b expref: 6 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568798.616487:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae27feaba00/0x41e82f464b6a1d62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a1d5b expref: 6 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568798.616495:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae27feaba00, rc 0) 00000100:00100000:0.0:1788568798.616553:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+6:14403:x1875449976281600:12345-0@lo:101:mount.lustre.0 Request processed in 123us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568798.616558:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788568798.616624:0:14403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:14403:1875449976281600:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788568798.616638:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae273b2ce00/0x41e82f464b6a1d5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1d62 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568798.616662:0:14403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae273b2ce00/0x41e82f464b6a1d5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a1d62 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568798.616715:0:14403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:14403:1875449976281728:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788568798.616744:0:14403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568798.617297:0:14403:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2526e1000 going to sleep for 11 seconds 00000100:00100000:1.0:1788568798.617365:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976281728 00000100:00100000:1.0:1788568798.617372:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976281728 00000100:00100000:1.0:1788568798.617399:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788568798.617406:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277a85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+6:14403:x1875449976281728:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788568798.617644:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277a85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+6:14403:x1875449976281728:12345-0@lo:501:mount.lustre.0 Request processed in 238us (898us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788568798.617652:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788568798.617789:0:14403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:14403:1875449976281728:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788568798.617841:0:14403:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788568798.617863:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae273b2ce00/0x41e82f464b6a1d5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1d62 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568798.617871:0:14403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae273b2ce00/0x41e82f464b6a1d5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1d62 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788568798.617880:0:14403:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ae26f783800 10000000:01000000:2.0:1788568798.617885:0:14403:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788568798.617889:0:14403:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ae26f783800 10000000:01000000:2.0:1788568798.617891:0:14403:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788568798.617895:0:14403:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9ae26f783800 from 1 10000000:01000000:2.0:1788568798.617897:0:14403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788568798.617921:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7ba00/0x41e82f464b6a1d69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568798.617946:0:14403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae252e7ba00/0x41e82f464b6a1d69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568798.617955:0:14403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae252e7ba00/0x41e82f464b6a1d69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568798.617977:0:14403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:14403:1875449976281856:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788568798.618006:0:14403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568798.618019:0:14403:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2526e1000 going to sleep for 11 seconds 00000100:00100000:1.0:1788568798.618165:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976281856 00000100:00100000:1.0:1788568798.618171:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976281856 00000100:00100000:1.0:1788568798.618189:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788568798.618195:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+6:14403:x1875449976281856:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788568798.618203:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568798.618215:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae273b2d600/0x41e82f464b6a1d70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a1d69 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568798.618232:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae273b2d600/0x41e82f464b6a1d70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a1d69 expref: 7 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568798.618241:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae273b2d600/0x41e82f464b6a1d70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a1d69 expref: 7 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568798.618248:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2d600, rc 0) 00000100:00100000:1.0:1788568798.618282:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+7:14403:x1875449976281856:12345-0@lo:101:mount.lustre.0 Request processed in 87us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568798.618289:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788568798.618357:0:14403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:14403:1875449976281856:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788568798.618368:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae252e7ba00/0x41e82f464b6a1d69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1d70 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568798.618376:0:14403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae252e7ba00/0x41e82f464b6a1d69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a1d70 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788568798.618387:0:14403:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788568798.618402:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7ba00/0x41e82f464b6a1d69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1d70 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568798.618409:0:14403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae252e7ba00/0x41e82f464b6a1d69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1d70 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788568798.618415:0:14403:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788568798.618418:0:14403:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788568798.618422:0:14403:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ae26f783800 10000000:01000000:2.0:1788568798.618425:0:14403:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788568798.618428:0:14403:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788568798.618430:0:14403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788568798.618443:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a400/0x41e82f464b6a1d77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568798.618450:0:14403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a400/0x41e82f464b6a1d77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568798.618463:0:14403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a400/0x41e82f464b6a1d77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568798.618475:0:14403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:14403:1875449976281984:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788568798.618499:0:14403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568798.618516:0:14403:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2526e1000 going to sleep for 11 seconds 00000100:00100000:1.0:1788568798.618637:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976281984 00000100:00100000:1.0:1788568798.618647:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976281984 00000100:00100000:1.0:1788568798.618664:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788568798.618670:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277a86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+7:14403:x1875449976281984:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788568798.618677:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568798.618684:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae273b2ca00/0x41e82f464b6a1d7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a1d77 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568798.618697:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae273b2ca00/0x41e82f464b6a1d7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a1d77 expref: 8 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568798.618705:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae273b2ca00/0x41e82f464b6a1d7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a1d77 expref: 8 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568798.618713:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2ca00, rc 0) 00000100:00100000:1.0:1788568798.618750:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277a86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+8:14403:x1875449976281984:12345-0@lo:101:mount.lustre.0 Request processed in 80us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568798.618757:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788568798.619080:0:14403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:14403:1875449976281984:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788568798.619091:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a400/0x41e82f464b6a1d77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1d7e expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568798.619099:0:14403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a400/0x41e82f464b6a1d77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a1d7e expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568798.619143:0:14403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:14403:1875449976282112:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788568798.619169:0:14403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568798.619196:0:14403:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2526e1000 going to sleep for 11 seconds 00000100:00100000:1.0:1788568798.619249:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976282112 00000100:00100000:1.0:1788568798.619254:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976282112 00000100:00100000:1.0:1788568798.619272:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788568798.619278:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277a84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+8:14403:x1875449976282112:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788568798.619665:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277a84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+9:14403:x1875449976282112:12345-0@lo:501:mount.lustre.0 Request processed in 385us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568798.619673:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788568798.619750:0:14403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:14403:1875449976282112:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788568798.619780:0:14403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:14403:1875449976282240:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788568798.619945:0:14403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568798.619966:0:14403:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2526e1000 going to sleep for 11 seconds 00000100:00100000:0.0:1788568798.620043:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976282240 00000100:00100000:0.0:1788568798.620048:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976282240 00000100:00100000:0.0:1788568798.620072:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788568798.620080:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277a84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+9:14403:x1875449976282240:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788568798.620375:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277a84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+9:14403:x1875449976282240:12345-0@lo:503:mount.lustre.0 Request processed in 294us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568798.620382:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788568798.620470:0:14403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:14403:1875449976282240:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788568798.621452:0:14439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273b65880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bbee97af-a6b0-4265-8c9f-26b826a76798:14439:1875449976282368:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788568798.621504:0:14439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568798.623971:0:14439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae253336d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788568798.624241:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976282368 00000100:00100000:0.0:1788568798.624251:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976282368 00000100:00100000:0.0:1788568798.624343:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788568798.624354:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2817bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+9:14439:x1875449976282368:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788568798.626390:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2817bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+9:14439:x1875449976282368:12345-0@lo:502:llog_process_th.0 Request processed in 2028us (4875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568798.626403:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788568798.627062:0:14439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273b65880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bbee97af-a6b0-4265-8c9f-26b826a76798:14439:1875449976282368:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788568798.627106:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788568798.627118:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788568798.627121:0:14439:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788568798.627126:0:14439:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788568798.627130:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788568798.627144:0:14439:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9ae26fb78000) 00000020:00000080:3.0:1788568798.627163:0:14439:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788568798.627169:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788568798.627245:0:14439:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788568798.627252:0:14439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x41e82f464b6a1d8c 00000020:00000080:3.0:1788568798.627457:0:14439:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788568798.627462:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788568798.627465:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788568798.627467:0:14439:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788568798.627469:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788568798.627479:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788568798.627481:0:14439:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788568798.627485:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788568798.627492:0:14439:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9ae26fb7cd40) 00000020:00000080:3.0:1788568798.627501:0:14439:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788568798.627505:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788568798.627507:0:14439:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788568798.627509:0:14439:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788568798.627514:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788568798.627571:0:14439:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ae26f783800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788568798.627593:0:14439:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9ae273a18000) 00000020:00000080:3.0:1788568798.627603:0:14439:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788568798.627652:0:14439:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788568798.627657:0:14439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x41e82f464b6a1da1 00000020:00000080:3.0:1788568798.627759:0:14439:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788568798.627765:0:14439:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788568798.627769:0:14439:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x41e82f464b6a1da8 00080000:01000000:3.0:1788568798.627774:0:14439:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788568798.627777:0:14439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x41e82f464b6a1daf 00010000:00010000:3.0:1788568798.710108:0:14439:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788568798.710530:0:14439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1788568798.713772:0:14439:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788568798.718624:0:14439:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9ae27bbc0000) 00000020:00000080:0.0:1788568798.718655:0:14439:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788568798.718752:0:14439:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788568798.718765:0:14439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x41e82f464b6a1dbd 00000020:00000080:1.0:1788568798.728876:0:14439:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788568798.735278:0:14439:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x41e82f464b6a1dc4 00000020:00000080:1.0:1788568798.736236:0:14439:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788568798.736246:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788568798.736262:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568798.736264:0:14439:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788568798.736268:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788568798.736271:0:14439:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1788568798.736272:0:14439:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788568798.736274:0:14439:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788568798.736275:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788568798.736277:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568798.736279:0:14439:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788568798.736281:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788568798.736285:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568798.736287:0:14439:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788568798.736292:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788568798.736331:0:14439:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788568798.736345:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788568798.736348:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568798.736349:0:14439:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788568798.736352:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788568798.736356:0:14439:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788568798.736359:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568798.736360:0:14439:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788568798.736363:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788568798.736369:0:14439:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.104@tcp to nid 0x20000c0a8ce68 (192.168.206.104@tcp) 00000020:01000000:1.0:1788568798.736394:0:14439:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788568798.736397:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788568798.736411:0:14439:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9ae251de0000) 00000020:00000080:1.0:1788568798.736426:0:14439:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788568798.736432:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788568798.736499:0:14439:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788568798.736505:0:14439:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788568798.736514:0:14439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x41e82f464b6a1dd2 00010000:00080000:1.0:1788568798.736558:0:14439:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae273841800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.104@tcp at head 00010000:00010000:1.0:1788568798.736768:0:14439:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1788568798.737414:0:14439:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788568798.737461:0:14439:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788568798.748716:0:14439:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788568798.748789:0:14439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1788568798.748876:0:14439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788568798.755625:0:14443:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788568798.755633:0:14443:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788568798.756765:0:14439:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788568798.756778:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788568798.756833:0:14439:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788568798.756853:0:14439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x41e82f464b6a1dd9 00000100:00080000:2.0:1788568798.756870:0:14439:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788568798.756876:0:14439:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ae273841800 using connection 192.168.206.104@tcp/0@lo 00000100:00100000:2.0:1788568798.756910:0:14439:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae2739f2d80 x1875449976282496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788568798.757199:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875449976282496:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788568798.757252:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875449976282496 offset 0 length 520: 4 00000100:00080000:2.0:1788568798.757329:0:14439:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788568798.757386:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788568798.757390:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788568798.757392:0:14439:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788568798.757395:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788568798.757398:0:14439:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1788568798.757399:0:14439:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788568798.757401:0:14439:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788568798.757402:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788568798.757406:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788568798.757407:0:14439:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788568798.757410:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788568798.757414:0:14439:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788568798.757418:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788568798.757419:0:14439:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788568798.757422:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788568798.757425:0:14439:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.104@tcp to nid 0x20000c0a8ce68 (192.168.206.104@tcp) 00000020:01000000:2.0:1788568798.757446:0:14439:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788568798.757449:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788568798.757460:0:14439:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9ae248dd8000) 00000020:00000080:2.0:1788568798.757473:0:14439:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788568798.757479:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788568798.757548:0:14439:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788568798.757555:0:14439:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788568798.757560:0:14439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x41e82f464b6a1de7 00010000:00080000:2.0:1788568798.757592:0:14439:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae277a7e800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.104@tcp at head 00010000:00010000:2.0:1788568798.757799:0:14439:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1788568798.758305:0:14439:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788568798.758328:0:14439:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788568798.759489:0:14439:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788568798.759579:0:14439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788568798.759668:0:14439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1788568798.760647:0:14445:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788568798.760651:0:14445:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788568798.761722:0:14439:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788568798.761732:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788568798.761763:0:14439:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788568798.761780:0:14439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x41e82f464b6a1dee 00000100:00080000:1.0:1788568798.761789:0:14439:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788568798.761807:0:14439:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ae277a7e800 using connection 192.168.206.104@tcp/0@lo 00000100:00100000:1.0:1788568798.761848:0:14439:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae273aa3480 x1875449976282624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788568798.761873:0:14439:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788568798.761962:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788568798.761968:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568798.761970:0:14439:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788568798.761973:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788568798.761977:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568798.761978:0:14439:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788568798.761981:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788568798.761983:0:14439:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788568798.761985:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788568798.761987:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568798.761989:0:14439:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788568798.762000:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788568798.762003:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568798.762004:0:14439:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788568798.762008:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788568798.762036:0:14439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bbee97af-a6b0-4265-8c9f-26b826a76798:14439:1875449976282752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788568798.762118:0:14439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568798.762157:0:14439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae244519b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788568798.762305:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976282752 00000100:00100000:3.0:1788568798.762312:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976282752 00000100:00100000:3.0:1788568798.762352:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788568798.762360:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2817bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+9:14439:x1875449976282752:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788568798.762530:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875449976282624:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788568798.762561:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875449976282624 offset 0 length 520: 4 00000100:00100000:3.0:1788568798.762622:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2817bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+9:14439:x1875449976282752:12345-0@lo:502:llog_process_th.0 Request processed in 261us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568798.762631:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788568798.762647:0:14439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bbee97af-a6b0-4265-8c9f-26b826a76798:14439:1875449976282752:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788568798.762677:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788568798.762682:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788568798.762684:0:14439:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788568798.762695:0:14439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1788568798.762773:0:14403:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1788568798.762797:0:14403:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788568798.762826:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a400/0x41e82f464b6a1d77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1d7e expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568798.762837:0:14403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae252e7a400/0x41e82f464b6a1d77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1d7e expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788568798.762844:0:14403:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ae26f783800 from 1 10000000:01000000:1.0:1788568798.762847:0:14403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788568798.762871:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d000/0x41e82f464b6a1df5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568798.762879:0:14403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d000/0x41e82f464b6a1df5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568798.762888:0:14403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d000/0x41e82f464b6a1df5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568798.762902:0:14403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:14403:1875449976282880:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788568798.763100:0:14403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568798.763124:0:14403:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae244519900 going to sleep for 11 seconds 00000100:00100000:0.0:1788568798.763206:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976282880 00000100:00100000:0.0:1788568798.763212:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976282880 00000100:00100000:0.0:1788568798.763248:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788568798.763256:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2817bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+9:14403:x1875449976282880:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788568798.763264:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568798.763277:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae27feab600/0x41e82f464b6a1dfc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a1df5 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568798.763310:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae27feab600/0x41e82f464b6a1dfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a1df5 expref: 10 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568798.763321:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae27feab600/0x41e82f464b6a1dfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a1df5 expref: 10 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568798.763329:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae27feab600, rc 0) 00000100:00100000:0.0:1788568798.763371:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2817bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+10:14403:x1875449976282880:12345-0@lo:101:mount.lustre.0 Request processed in 115us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568798.763378:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788568798.763415:0:14403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:14403:1875449976282880:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788568798.763428:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d000/0x41e82f464b6a1df5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1dfc expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568798.763439:0:14403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d000/0x41e82f464b6a1df5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a1dfc expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568798.765195:0:14403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:14403:1875449976283008:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788568798.769149:0:14403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568798.769196:0:14403:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae244519900 going to sleep for 11 seconds 00000100:00100000:2.0:1788568798.769221:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976283008 00000100:00100000:2.0:1788568798.769231:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976283008 00000100:00100000:2.0:1788568798.769281:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788568798.769290:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2817bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+10:14403:x1875449976283008:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788568798.769311:0:14414:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788568798.769317:0:14414:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788568798.769403:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2817bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+10:14403:x1875449976283008:12345-0@lo:256:mount.lustre.0 Request processed in 114us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568798.769410:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788568798.775375:0:14403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:14403:1875449976283008:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788568798.776093:0:14403:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788568798.776300:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d000/0x41e82f464b6a1df5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1dfc expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568798.776313:0:14403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d000/0x41e82f464b6a1df5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1dfc expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788568798.776323:0:14403:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae26f783800 from 1 10000000:01000000:1.0:1788568798.776325:0:14403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788568798.776367:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae273b2c600/0x41e82f464b6a1e03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568798.776375:0:14403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae273b2c600/0x41e82f464b6a1e03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568798.776386:0:14403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae273b2c600/0x41e82f464b6a1e03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568798.776407:0:14403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:14403:1875449976283136:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788568798.776478:0:14403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568798.776516:0:14403:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae244519900 going to sleep for 11 seconds 00000100:00100000:2.0:1788568798.776641:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976283136 00000100:00100000:2.0:1788568798.776650:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976283136 00000100:00100000:2.0:1788568798.776704:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788568798.776713:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2817bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+10:14403:x1875449976283136:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788568798.776728:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568798.776745:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae252e7b000/0x41e82f464b6a1e0a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a1e03 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568798.776786:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae252e7b000/0x41e82f464b6a1e0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a1e03 expref: 11 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568798.776796:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae252e7b000/0x41e82f464b6a1e0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a1e03 expref: 11 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568798.776806:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7b000, rc 0) 00000100:00100000:2.0:1788568798.776867:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2817bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+11:14403:x1875449976283136:12345-0@lo:101:mount.lustre.0 Request processed in 155us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568798.776874:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788568798.777000:0:14403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:14403:1875449976283136:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788568798.777015:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae273b2c600/0x41e82f464b6a1e03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1e0a expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568798.777023:0:14403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae273b2c600/0x41e82f464b6a1e03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a1e0a expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568798.777089:0:14403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b566300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:14403:1875449976283264:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788568798.777119:0:14403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568798.777151:0:14403:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27906c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788568798.779078:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976283264 00000100:00100000:1.0:1788568798.779093:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976283264 00000100:00100000:1.0:1788568798.779171:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788568798.779181:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2817bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+11:14403:x1875449976283264:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788568798.779619:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2817bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+11:14403:x1875449976283264:12345-0@lo:501:mount.lustre.0 Request processed in 438us (2497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568798.779627:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788568798.779691:0:14403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b566300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:14403:1875449976283264:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788568798.779742:0:14403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b566300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:14403:1875449976283392:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788568798.779798:0:14403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568798.779842:0:14403:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27906c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788568798.781545:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976283392 00000100:00100000:1.0:1788568798.781557:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976283392 00000100:00100000:1.0:1788568798.781664:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788568798.781673:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2817bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+11:14403:x1875449976283392:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788568798.781884:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2817bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+11:14403:x1875449976283392:12345-0@lo:503:mount.lustre.0 Request processed in 211us (2085us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568798.781892:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788568798.782358:0:14403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b566300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:14403:1875449976283392:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788568798.786730:0:14447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bbee97af-a6b0-4265-8c9f-26b826a76798:14447:1875449976283520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788568798.786821:0:14447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568798.791644:0:14447:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2526e1540 going to sleep for 11 seconds 00000100:00100000:0.0:1788568798.792945:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976283520 00000100:00100000:0.0:1788568798.792974:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976283520 00000100:00100000:0.0:1788568798.793031:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788568798.793040:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2817bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+11:14447:x1875449976283520:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788568798.793356:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2817bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+11:14447:x1875449976283520:12345-0@lo:502:llog_process_th.0 Request processed in 317us (6544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568798.793365:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788568798.796524:0:14447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bbee97af-a6b0-4265-8c9f-26b826a76798:14447:1875449976283520:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788568798.796575:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788568798.796587:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788568798.796589:0:14447:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788568798.796598:0:14447:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ae26f783800 00000020:00000080:2.0:1788568798.796601:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788568798.796608:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788568798.796610:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788568798.796612:0:14447:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788568798.796614:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788568798.796616:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788568798.796618:0:14447:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788568798.796621:0:14447:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ae26f783800 00000020:00000080:2.0:1788568798.796634:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788568798.796697:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788568798.796700:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788568798.796702:0:14447:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788568798.796704:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788568798.796707:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788568798.796708:0:14447:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788568798.796711:0:14447:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ae26f783800 00000020:00000080:2.0:1788568798.796713:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788568798.796761:0:14447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bbee97af-a6b0-4265-8c9f-26b826a76798:14447:1875449976283648:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788568798.796837:0:14447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568798.796868:0:14447:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2526e1540 going to sleep for 11 seconds 00000100:00100000:1.0:1788568798.803081:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976283648 00000100:00100000:1.0:1788568798.803097:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976283648 00000100:00100000:1.0:1788568798.803157:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788568798.803168:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2817bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+11:14447:x1875449976283648:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788568798.803500:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2817bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+11:14447:x1875449976283648:12345-0@lo:502:llog_process_th.0 Request processed in 333us (6662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568798.803509:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788568798.805267:0:14447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bbee97af-a6b0-4265-8c9f-26b826a76798:14447:1875449976283648:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788568798.805315:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788568798.805330:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788568798.805332:0:14447:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788568798.805339:0:14447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788568798.807578:0:14403:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788568798.807605:0:14403:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788568798.807643:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae273b2c600/0x41e82f464b6a1e03 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1e0a expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568798.807656:0:14403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae273b2c600/0x41e82f464b6a1e03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1e0a expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788568798.807705:0:14403:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788568798.807709:0:14403:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ae26f783800 10000000:01000000:3.0:1788568798.807712:0:14403:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ae26f783800 10000000:01000000:3.0:1788568798.807716:0:14403:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788568798.807722:0:14403:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ae26f783800 from 1 10000000:01000000:3.0:1788568798.807725:0:14403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788568798.807760:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae2429dea00/0x41e82f464b6a1e11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568798.807770:0:14403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae2429dea00/0x41e82f464b6a1e11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568798.807781:0:14403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae2429dea00/0x41e82f464b6a1e11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568798.807806:0:14403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273b65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:14403:1875449976283776:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788568798.807877:0:14403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568798.807917:0:14403:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2446050c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788568798.808472:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976283776 00000100:00100000:1.0:1788568798.808481:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976283776 00000100:00100000:1.0:1788568798.808531:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788568798.808541:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2817bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+11:14403:x1875449976283776:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788568798.808553:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568798.808568:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae273b2cc00/0x41e82f464b6a1e18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a1e11 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568798.808603:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae273b2cc00/0x41e82f464b6a1e18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a1e11 expref: 12 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568798.808614:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae273b2cc00/0x41e82f464b6a1e18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a1e11 expref: 12 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568798.808623:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2cc00, rc 0) 00000100:00100000:1.0:1788568798.808679:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2817bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+12:14403:x1875449976283776:12345-0@lo:101:mount.lustre.0 Request processed in 140us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568798.808686:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788568798.812470:0:14403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273b65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:14403:1875449976283776:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788568798.812498:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae2429dea00/0x41e82f464b6a1e11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1e18 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568798.812511:0:14403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae2429dea00/0x41e82f464b6a1e11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a1e18 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568798.812615:0:14403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273b65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:14403:1875449976283904:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788568798.812673:0:14403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568798.812719:0:14403:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2446050c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788568798.813099:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976283904 00000100:00100000:1.0:1788568798.813107:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976283904 00000100:00100000:1.0:1788568798.813159:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788568798.813169:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2817be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+12:14403:x1875449976283904:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788568798.813455:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2817be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+12:14403:x1875449976283904:12345-0@lo:501:mount.lustre.0 Request processed in 286us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568798.813464:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788568798.815200:0:14403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273b65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:14403:1875449976283904:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788568798.815329:0:14403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273b65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:14403:1875449976284032:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788568798.815394:0:14403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568798.815581:0:14403:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2446050c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788568798.816379:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976284032 00000100:00100000:2.0:1788568798.816389:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976284032 00000100:00100000:2.0:1788568798.816452:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788568798.816462:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2817bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+12:14403:x1875449976284032:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788568798.816670:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2817bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+12:14403:x1875449976284032:12345-0@lo:503:mount.lustre.0 Request processed in 209us (1274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568798.816677:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788568798.816682:0:14403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273b65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:14403:1875449976284032:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788568798.817857:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bbee97af-a6b0-4265-8c9f-26b826a76798:14451:1875449976284160:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788568798.817918:0:14451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568798.817984:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae244519840 going to sleep for 11 seconds 00000100:00100000:2.0:1788568798.818290:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976284160 00000100:00100000:2.0:1788568798.818296:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976284160 00000100:00100000:2.0:1788568798.818332:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788568798.818340:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2817be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+12:14451:x1875449976284160:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788568798.818565:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2817be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+12:14451:x1875449976284160:12345-0@lo:502:llog_process_th.0 Request processed in 225us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568798.818578:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788568798.819371:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bbee97af-a6b0-4265-8c9f-26b826a76798:14451:1875449976284160:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788568798.819437:0:14451:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788568798.819451:0:14451:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9ae27bbc4d40) 00000020:00000080:0.0:1788568798.819470:0:14451:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1788568798.819545:0:14451:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ae26f783800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788568798.819550:0:14451:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ae26f783800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788568798.819552:0:14451:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae26f783800 4 00010000:00080000:0.0:1788568798.819576:0:14451:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae27ff25800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.104@tcp at head 00010000:00010000:0.0:1788568798.823694:0:14451:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1788568798.823893:0:14451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788568798.823949:0:14451:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788568798.823962:0:14451:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x41e82f464b6a1e26 00000100:00080000:0.0:1788568798.823972:0:14451:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788568798.823978:0:14451:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9ae27ff25800 using connection 192.168.206.104@tcp/0@lo 00000100:00100000:0.0:1788568798.824011:0:14451:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae27b565180 x1875449976284288/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788568798.824043:0:14451:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788568798.824231:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b565180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875449976284288:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788568798.824295:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568798.829944:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976284288 00000100:00100000:0.0:1788568798.829958:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976284288 00000100:00100000:0.0:1788568798.833528:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788568798.833540:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1875449976284288:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788568798.833649:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1875449976284288:12345-0@lo:38:llog_process_th.0 Request processed in 108us (9354us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788568798.833656:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788568798.833718:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788568798.833725:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ae27ff25800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788568798.833729:0:3305:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788568798.833733:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b565180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875449976284288:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788568798.843772:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b565180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bbee97af-a6b0-4265-8c9f-26b826a76798:14451:1875449976284416:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788568798.843859:0:14451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568798.843899:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae25042a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788568798.843974:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976284416 00000100:00100000:2.0:1788568798.843982:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976284416 00000100:00100000:2.0:1788568798.844021:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788568798.844030:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273ab9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+12:14451:x1875449976284416:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788568798.844376:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273ab9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+12:14451:x1875449976284416:12345-0@lo:502:llog_process_th.0 Request processed in 345us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568798.844384:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788568798.844468:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b565180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bbee97af-a6b0-4265-8c9f-26b826a76798:14451:1875449976284416:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788568798.844494:0:14451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788568798.851630:0:14403:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788568798.851662:0:14403:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788568798.851690:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae2429dea00/0x41e82f464b6a1e11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1e18 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568798.851703:0:14403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae2429dea00/0x41e82f464b6a1e11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1e18 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788568798.851755:0:14403:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788568798.851757:0:14403:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788568798.851758:0:14403:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788568798.851760:0:14403:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788568798.851761:0:14403:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788568798.851763:0:14403:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788568798.851764:0:14403:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788568798.851765:0:14403:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788568798.851767:0:14403:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788568798.851768:0:14403:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788568798.851772:0:14403:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788568798.851774:0:14403:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788568798.851776:0:14403:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788568798.851777:0:14403:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788568798.851778:0:14403:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788568798.851783:0:14403:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788568798.851785:0:14403:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788568798.851786:0:14403:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788568798.851787:0:14403:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788568798.851788:0:14403:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788568798.851788:0:14403:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788568798.851824:0:14403:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788568798.851845:0:14403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:14403:1875449976284544:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788568798.851912:0:14403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568798.851968:0:14403:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae253336f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788568798.851991:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976284544 00000100:00100000:2.0:1788568798.851998:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976284544 00000100:00100000:2.0:1788568798.852036:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788568798.852044:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273abac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+12:14403:x1875449976284544:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788568798.852078:0:14414:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788568798.852091:0:14414:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788568798.889153:0:14414:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788568798.889169:0:14414:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788568798.889743:0:14437:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788568798.889749:0:14437:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788568798.889773:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ae2429df200/0x41e82f464b6a1e2d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568798.889793:0:14437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae27feab600/0x41e82f464b6a1dfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a1df5 expref: 12 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568798.889802:0:14437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ae2429df200/0x41e82f464b6a1e2d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568798.889856:0:14437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae27feab600/0x41e82f464b6a1dfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x41e82f464b6a1df5 expref: 12 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568798.889871:0:14437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae27feab600/0x41e82f464b6a1dfc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x41e82f464b6a1df5 expref: 12 pid: 14415 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568798.889903:0:14437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273b65c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14437:1875449976284672:0@lo:104: 00000100:00100000:3.0:1788568798.889983:0:14437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568798.890030:0:14437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2446050c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788568798.890106:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976284672 00000100:00100000:0.0:1788568798.890114:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976284672 00000100:00100000:0.0:1788568798.890162:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788568798.890171:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bbee97af-a6b0-4265-8c9f-26b826a76798+3:14437:x1875449976284672:12345-0@lo:104: 00010000:00010000:0.0:1788568798.890184:0:14404:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d000/0x41e82f464b6a1df5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a1dfc expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568798.890247:0:14404:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788568798.890253:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bbee97af-a6b0-4265-8c9f-26b826a76798+3:14437:x1875449976284672:12345-0@lo:104: Request processed in 84us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568798.890260:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788568798.890278:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788568798.890283:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d000/0x41e82f464b6a1df5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a1dfc expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568798.890302:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2d000 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:0.0:1788568798.890306:0:14410:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d000/0x41e82f464b6a1df5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x41e82f464b6a1dfc expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568798.890314:0:14410:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d000/0x41e82f464b6a1df5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x41e82f464b6a1dfc expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788568798.890321:0:14410:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d000/0x41e82f464b6a1df5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x41e82f464b6a1dfc expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568798.890328:0:14410:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788568798.890354:0:14410:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d000/0x41e82f464b6a1df5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a1dfc expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568798.890361:0:14410:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788568798.890378:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d000/0x41e82f464b6a1df5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a1dfc expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568798.890385:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d000/0x41e82f464b6a1df5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a1dfc expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568798.890401:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568798.890402:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568798.890404:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568798.890427:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788568798.890436:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b565180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bbee97af-a6b0-4265-8c9f-26b826a76798:3309:1875449976284800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788568798.890463:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568798.890507:0:14437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273b65c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14437:1875449976284672:0@lo:104: 00010000:00010000:0.0:1788568798.890523:0:14437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ae2429df200/0x41e82f464b6a1e2d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568798.893091:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976284800 00000100:00100000:0.0:1788568798.893105:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976284800 00010000:00010000:0.0:1788568798.893138:0:14406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae27feab600/0x41e82f464b6a1dfc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a1df5 expref: 13 pid: 14415 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568798.893180:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788568798.893250:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b566300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbee97af-a6b0-4265-8c9f-26b826a76798+13:3309:x1875449976284800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788568798.893265:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568798.893271:0:14406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae27feab600/0x41e82f464b6a1dfc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a1df5 expref: 13 pid: 14415 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568798.893284:0:14406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae27feab600/0x41e82f464b6a1dfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x41e82f464b6a1df5 expref: 13 pid: 14415 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568798.893302:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae27feab600/0x41e82f464b6a1dfc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x41e82f464b6a1df5 expref: 13 pid: 14415 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568798.893319:0:14406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ae2429df200/0x41e82f464b6a1e2d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568798.893328:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae2429df200/0x41e82f464b6a1e2d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788568798.893343:0:14406:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003595039s 00010000:00010000:0.0:1788568798.893347:0:14406:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae2429df200/0x41e82f464b6a1e2d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568798.893354:0:14406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae2429df200/0x41e82f464b6a1e2d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568798.893370:0:14406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ae2429df200/0x41e82f464b6a1e2d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568798.893377:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ae2429df200/0x41e82f464b6a1e2d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568798.893382:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429df200 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788568798.893386:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ae2429df200/0x41e82f464b6a1e2d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568798.893395:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ae2429df200/0x41e82f464b6a1e2d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568798.893410:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ae2429df200/0x41e82f464b6a1e2d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568798.893420:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788568798.893482:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b566300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbee97af-a6b0-4265-8c9f-26b826a76798+12:3309:x1875449976284800:12345-0@lo:103:ldlm_bl.0 Request processed in 293us (3016us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568798.893489:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788568798.893529:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b565180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bbee97af-a6b0-4265-8c9f-26b826a76798:3309:1875449976284800:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788568798.894535:0:14437:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ae2429df200/0x41e82f464b6a1e2d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568798.895048:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ae2429df200/0x41e82f464b6a1e2d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568798.895055:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae2429df200/0x41e82f464b6a1e2d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568798.896332:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273abac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+11:14403:x1875449976284544:12345-0@lo:253:mount.lustre.0 Request processed in 44279us (44410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568798.896345:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788568798.896448:0:14403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:14403:1875449976284544:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788568798.896464:0:14403:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788568798.896467:0:14403:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788568798.896469:0:14403:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788568798.896470:0:14403:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788568798.896471:0:14403:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788568798.896473:0:14403:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788568798.896474:0:14403:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788568798.896475:0:14403:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788568798.896476:0:14403:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788568798.896477:0:14403:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788568798.896479:0:14403:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788568798.896495:0:14403:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788568798.902438:0:14403:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788568798.902620:0:14403:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788568798.902910:0:14403:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788568798.903131:0:14403:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788568798.903399:0:14403:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788568798.903553:0:14403:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788568798.905429:0:14403:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788568798.905672:0:14403:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788568798.906048:0:14403:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788568798.906330:0:14403:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788568798.906732:0:14403:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788568798.907146:0:14403:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1788568798.967775:0:14403:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1788568798.969316:0:14403:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1788568798.969744:0:14461:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1788568798.969852:0:14461:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1788568798.972093:0:14403:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000020:00080000:3.0:1788568798.972492:0:14460:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788568798.972497:0:14460:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:3.0:1788568798.974692:0:14403:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788568798.975250:0:14403:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788568798.975264:0:14403:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788568798.976908:0:14461:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788568798.977019:0:14461:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788568798.977024:0:14461:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:3.0:1788568798.977353:0:14403:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788568798.978428:0:14403:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788568798.981393:0:14403:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788568798.981431:0:14403:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1788568798.983220:0:14403:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1788568798.991443:0:14403:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1788568799.042773:0:14403:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788568799.042820:0:14403:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbd7901c8b988 00100000:10000000:2.0:1788568799.042828:0:14403:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788568799.044989:0:14403:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788568799.045006:0:14403:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.104@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788568799.045018:0:14403:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788568799.045040:0:14403:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1788568799.487885:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788568799.863990:0:14454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1788568800.120971:0:14418:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788568800.120979:0:14418:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ae26f783800 from 6 10000000:01000000:0.0:1788568800.120984:0:14418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788568800.121029:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae27feab200/0x41e82f464b6a1e34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568800.121042:0:14418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae27feab200/0x41e82f464b6a1e34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568800.121052:0:14418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae27feab200/0x41e82f464b6a1e34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568800.121076:0:14418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b565180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbee97af-a6b0-4265-8c9f-26b826a76798:14418:1875449976284928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788568800.121144:0:14418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568800.121198:0:14418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae25042acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788568800.121537:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976284928 00000100:00100000:2.0:1788568800.121546:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976284928 00000100:00100000:2.0:1788568800.121609:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788568800.121618:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273ab8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+11:14418:x1875449976284928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788568800.121631:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568800.121644:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae252e7b600/0x41e82f464b6a1e3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a1e34 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568800.121666:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae252e7b600/0x41e82f464b6a1e3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a1e34 expref: 12 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568800.121677:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae252e7b600/0x41e82f464b6a1e3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a1e34 expref: 12 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568800.121686:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7b600, rc 0) 00000100:00100000:2.0:1788568800.122051:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273ab8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+12:14418:x1875449976284928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 432us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568800.122059:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788568800.126462:0:14418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b565180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbee97af-a6b0-4265-8c9f-26b826a76798:14418:1875449976284928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788568800.126491:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae27feab200/0x41e82f464b6a1e34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1e3b expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568800.126503:0:14418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae27feab200/0x41e82f464b6a1e34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a1e3b expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568800.127121:0:14418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbee97af-a6b0-4265-8c9f-26b826a76798:14418:1875449976285056:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788568800.127187:0:14418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568800.127240:0:14418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae251ea0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788568800.127332:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976285056 00000100:00100000:2.0:1788568800.127339:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976285056 00000100:00100000:2.0:1788568800.127449:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788568800.127459:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+12:14418:x1875449976285056:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788568800.127480:0:14414:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788568800.127497:0:14414:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788568800.127500:0:14414:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788568800.128067:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+12:14418:x1875449976285056:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 608us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568800.128084:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788568800.129270:0:14418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbee97af-a6b0-4265-8c9f-26b826a76798:14418:1875449976285056:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788568800.129330:0:14418:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788568800.129340:0:14418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae27feab200/0x41e82f464b6a1e34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1e3b expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568800.129351:0:14418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae27feab200/0x41e82f464b6a1e34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1e3b expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568800.504133:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788568800.893463:0:14454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788568801.527162:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568802.556304:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788568802.988299:0:14703:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg604-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788568803.581687:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788568803.831068:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788568803.831075:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788568803.831078:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788568803.831081:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788568803.831084:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788568803.831087:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788568803.831091:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ae27ff25800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788568803.831102:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9ae27ff25800 using connection 192.168.206.104@tcp/0@lo 00000100:00100000:2.0:1788568803.831124:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae2739f0000 x1875449976285312/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788568803.831175:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875449976285312:0@lo:38:kworker.0 00000100:00100000:2.0:1788568803.831239:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568803.831427:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bbee97af-a6b0-4265-8c9f-26b826a76798:3309:1875449976285184:0@lo:400:kworker.0 00000100:00100000:0.0:1788568803.831463:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568803.831594:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976285312 00000100:00100000:0.0:1788568803.831601:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976285312 00000100:00100000:0.0:1788568803.831631:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788568803.831638:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1875449976285312:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788568803.831659:0:14423:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 438 last 0 00000020:00000080:0.0:1788568803.831694:0:14423:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x41e82f464b6a1e42 00000004:00100000:0.0:1788568803.831706:0:14423:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788568803.831839:0:14423:0:(import.c:65:import_set_state_nolock()) ffff9ae251c84800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788568803.831883:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875449976285312:12345-0@lo:38:kworker.0 Request processed in 245us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568803.831891:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788568803.832075:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976285184 00000100:00100000:2.0:1788568803.832080:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976285184 00000100:00100000:2.0:1788568803.832115:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788568803.832123:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273ab8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+12:3309:x1875449976285184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568803.832162:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273ab8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+12:3309:x1875449976285184:12345-0@lo:400:kworker.0 Request processed in 40us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568803.832168:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788568803.832208:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bbee97af-a6b0-4265-8c9f-26b826a76798:3309:1875449976285184:0@lo:400:kworker.0 00010000:00080000:2.0:1788568803.832241:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ae2739f0000 x1875449976285312/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788568813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788568803.832266:0:3305:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788568803.832273:0:3305:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788568803.832278:0:3305:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788568803.832280:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ae27ff25800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788568803.832285:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875449976285312:0@lo:38:kworker.0 00010000:00010000:0.0:1788568804.600870:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568805.623678:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788568805.650443:0:14855:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc9f61e7a0 20000000:00000080:3.0:1788568805.650460:0:14855:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ae27d4f3800 uarg=0000000000000000 20000000:01000000:3.0:1788568805.650491:0:14855:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788568805.650497:0:14855:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788568805.650502:0:14855:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788568805.651992:0:14856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1788568805.652214:0:14855:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788568805.660364:0:14855:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788568805.660480:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ae27feaa200/0x41e82f464b6a1e49 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568805.660499:0:14855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae252e7b000/0x41e82f464b6a1e0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a1e03 expref: 11 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568805.660519:0:14855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ae27feaa200/0x41e82f464b6a1e49 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568805.660563:0:14855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae252e7b000/0x41e82f464b6a1e0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x41e82f464b6a1e03 expref: 11 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568805.660711:0:14855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae252e7b000/0x41e82f464b6a1e0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x41e82f464b6a1e03 expref: 11 pid: 14416 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568805.660729:0:14855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b567480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14855:1875449976285440:0@lo:104: 00000100:00100000:0.0:1788568805.660810:0:14855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568805.660922:0:14855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae244836c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788568805.663727:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976285440 00000100:00100000:3.0:1788568805.663743:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976285440 00000100:00100000:3.0:1788568805.663855:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788568805.663867:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b566a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bbee97af-a6b0-4265-8c9f-26b826a76798+3:14855:x1875449976285440:12345-0@lo:104: 00010000:00010000:3.0:1788568805.663883:0:14405:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.104@tcp lock: ffff9ae273b2c600/0x41e82f464b6a1e03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a1e0a expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568805.664110:0:14855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b567480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14855:1875449976285440:0@lo:104: 00010000:00010000:1.0:1788568805.664136:0:14855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ae27feaa200/0x41e82f464b6a1e49 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568805.664491:0:14405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788568805.664499:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b566a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bbee97af-a6b0-4265-8c9f-26b826a76798+3:14855:x1875449976285440:12345-0@lo:104: Request processed in 636us (3689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568805.664517:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788568805.664675:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788568805.664682:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae273b2c600/0x41e82f464b6a1e03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a1e0a expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568805.664689:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2c600 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:2.0:1788568805.664694:0:14410:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae273b2c600/0x41e82f464b6a1e03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x41e82f464b6a1e0a expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568805.664701:0:14410:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae273b2c600/0x41e82f464b6a1e03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x41e82f464b6a1e0a expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788568805.664708:0:14410:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae273b2c600/0x41e82f464b6a1e03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x41e82f464b6a1e0a expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788568805.664713:0:14410:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788568805.664757:0:14410:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae273b2c600/0x41e82f464b6a1e03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a1e0a expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568805.664764:0:14410:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788568805.664796:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae273b2c600/0x41e82f464b6a1e03 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a1e0a expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568805.664804:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae273b2c600/0x41e82f464b6a1e03 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a1e0a expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568805.664832:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568805.664833:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568805.664835:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568805.664859:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bbee97af-a6b0-4265-8c9f-26b826a76798:3306:1875449976285568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788568805.664898:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568805.664982:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976285568 00000100:00100000:2.0:1788568805.664988:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976285568 00010000:00010000:2.0:1788568805.665007:0:14406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae252e7b000/0x41e82f464b6a1e0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a1e03 expref: 12 pid: 14416 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568805.665027:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788568805.665034:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbee97af-a6b0-4265-8c9f-26b826a76798+12:3306:x1875449976285568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788568805.665043:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568805.665299:0:14406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae252e7b000/0x41e82f464b6a1e0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a1e03 expref: 12 pid: 14416 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568805.665312:0:14406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae252e7b000/0x41e82f464b6a1e0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x41e82f464b6a1e03 expref: 12 pid: 14416 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568805.665326:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae252e7b000/0x41e82f464b6a1e0a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x41e82f464b6a1e03 expref: 12 pid: 14416 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568805.665340:0:14406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ae27feaa200/0x41e82f464b6a1e49 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568805.665348:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae27feaa200/0x41e82f464b6a1e49 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568805.665363:0:14406:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae27feaa200/0x41e82f464b6a1e49 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568805.665376:0:14406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae27feaa200/0x41e82f464b6a1e49 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568805.665383:0:14406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ae27feaa200/0x41e82f464b6a1e49 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568805.665390:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ae27feaa200/0x41e82f464b6a1e49 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568805.665395:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaa200 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:2.0:1788568805.665400:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ae27feaa200/0x41e82f464b6a1e49 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568805.665407:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ae27feaa200/0x41e82f464b6a1e49 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568805.665696:0:14855:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ae27feaa200/0x41e82f464b6a1e49 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568805.665705:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ae27feaa200/0x41e82f464b6a1e49 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568805.666031:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ae27feaa200/0x41e82f464b6a1e49 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568805.666042:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae27feaa200/0x41e82f464b6a1e49 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568805.666688:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568805.666807:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbee97af-a6b0-4265-8c9f-26b826a76798+11:3306:x1875449976285568:12345-0@lo:103:ldlm_bl.0 Request processed in 1771us (1906us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568805.666816:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788568805.671592:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bbee97af-a6b0-4265-8c9f-26b826a76798:3306:1875449976285568:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788568806.649905:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788568807.351058:0:14418:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788568807.351070:0:14418:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae26f783800 from 10 10000000:01000000:1.0:1788568807.351077:0:14418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788568807.351142:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d000/0x41e82f464b6a1e50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568807.351157:0:14418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d000/0x41e82f464b6a1e50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568807.351170:0:14418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d000/0x41e82f464b6a1e50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568807.351201:0:14418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbee97af-a6b0-4265-8c9f-26b826a76798:14418:1875449976285696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788568807.351291:0:14418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568807.351392:0:14418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae141c42180 going to sleep for 11 seconds 00000100:00100000:3.0:1788568807.351443:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976285696 00000100:00100000:3.0:1788568807.351456:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976285696 00000100:00100000:1.0:1788568807.358995:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788568807.359014:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273abb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+11:14418:x1875449976285696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788568807.359039:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568807.359065:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae273b2dc00/0x41e82f464b6a1e57 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a1e50 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568807.359102:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae273b2dc00/0x41e82f464b6a1e57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a1e50 expref: 12 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568807.359114:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae273b2dc00/0x41e82f464b6a1e57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a1e50 expref: 12 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568807.359124:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2dc00, rc 0) 00000100:00100000:1.0:1788568807.359242:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273abb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+12:14418:x1875449976285696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 233us (7951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568807.359250:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788568807.359328:0:14418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbee97af-a6b0-4265-8c9f-26b826a76798:14418:1875449976285696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788568807.359351:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d000/0x41e82f464b6a1e50 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1e57 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568807.359362:0:14418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d000/0x41e82f464b6a1e50 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a1e57 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568807.359455:0:14418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbee97af-a6b0-4265-8c9f-26b826a76798:14418:1875449976285824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788568807.359495:0:14418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568807.359527:0:14418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae141c42180 going to sleep for 11 seconds 00000100:00100000:0.0:1788568807.359627:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976285824 00000100:00100000:0.0:1788568807.359635:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976285824 00000100:00100000:0.0:1788568807.359674:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788568807.359683:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273ab9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+12:14418:x1875449976285824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788568807.360131:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273ab9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+12:14418:x1875449976285824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 447us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568807.360140:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788568807.360190:0:14418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbee97af-a6b0-4265-8c9f-26b826a76798:14418:1875449976285824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788568807.360236:0:14418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b564000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbee97af-a6b0-4265-8c9f-26b826a76798:14418:1875449976285952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788568807.360284:0:14418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568807.360308:0:14418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae244519600 going to sleep for 11 seconds 00000100:00100000:0.0:1788568807.360323:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976285952 00000100:00100000:0.0:1788568807.360328:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976285952 00000100:00100000:0.0:1788568807.360354:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788568807.360361:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273abb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+12:14418:x1875449976285952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788568807.360540:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273abb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+12:14418:x1875449976285952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 179us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568807.360548:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788568807.360596:0:14418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b564000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbee97af-a6b0-4265-8c9f-26b826a76798:14418:1875449976285952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788568807.367714:0:14923:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788568807.368091:0:14418:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788568807.368122:0:14418:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788568807.368135:0:14418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d000/0x41e82f464b6a1e50 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1e57 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568807.368149:0:14418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d000/0x41e82f464b6a1e50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1e57 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568807.672161:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568808.695146:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568808.953028:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788568798/real 1788568798] req@ffff9ae273aa3480 x1875449976282624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788568808 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568808.953090:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ae273aa3480 x1875449976282624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788568808 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568808.953102:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788568798/real 1788568798] req@ffff9ae2739f2d80 x1875449976282496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788568808 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568808.953115:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ae2739f2d80 x1875449976282496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788568808 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788568808.953150:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ae277a7e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788568808.953161:0:3305:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788568808.953166:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875449976282624:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788568808.953174:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ae273841800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788568808.953178:0:3305:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788568808.953182:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875449976282496:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788568808.954157:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788568808.954163:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788568808.954167:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ae273841800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788568808.954175:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 433 00000100:00080000:3.0:1788568808.954182:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788568808.954190:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ae273841800 using connection 192.168.206.104@tcp/0@lo 00000100:00100000:3.0:1788568808.954216:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae273b67800 x1875449976286208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788568808.954245:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788568808.954249:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788568808.954250:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ae277a7e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788568808.954254:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 433 00000100:00080000:3.0:1788568808.954257:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788568808.954261:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ae277a7e800 using connection 192.168.206.104@tcp/0@lo 00000100:00100000:3.0:1788568808.954276:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae273b65c00 x1875449976286336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788568808.954357:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788568808.954372:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bbee97af-a6b0-4265-8c9f-26b826a76798:3306:1875449976286080:0@lo:400:kworker.0 00000100:00100000:3.0:1788568808.954465:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568808.954528:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875449976286464:0@lo:400:kworker.0 00000100:00100000:3.0:1788568808.954678:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568808.954854:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976286080 00000100:00100000:3.0:1788568808.954864:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976286080 00000100:00100000:3.0:1788568808.954918:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788568808.954960:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273abbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+12:3306:x1875449976286080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568808.955021:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273abbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+12:3306:x1875449976286080:12345-0@lo:400:kworker.0 Request processed in 93us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568808.955029:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788568808.955084:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976286464 00000100:00100000:3.0:1788568808.955089:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976286464 00000100:00100000:3.0:1788568808.955116:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788568808.955191:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273b66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875449976286464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568808.955231:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273b66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875449976286464:12345-0@lo:400:kworker.0 Request processed in 109us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568808.955248:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788568808.955293:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bbee97af-a6b0-4265-8c9f-26b826a76798:3306:1875449976286080:0@lo:400:kworker.0 00010000:00080000:3.0:1788568808.955330:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ae273b64000 x1875449976286464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568808.955342:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875449976286464:0@lo:400:kworker.0 00000100:00100000:3.0:1788568808.955389:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875449976286208:0@lo:8:kworker.0 00000400:00000100:3.0:1788568808.955417:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875449976286208 offset 0 length 520: 4 00000100:00100000:3.0:1788568808.955432:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273b65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875449976286336:0@lo:8:kworker.0 00000400:00000100:3.0:1788568808.955448:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875449976286336 offset 0 length 520: 4 00010000:00010000:0.0:1788568809.719885:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788568810.108838:0:14454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788568810.743123:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788568811.105738:0:15103:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788568811.105744:0:15103:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788568811.105894:0:15103:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ae281739800 00000020:01000004:2.0:1788568811.105916:0:15103:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788568811.105965:0:15103:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788568811.105983:0:15103:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9ae248ddcd40) 00000020:00000080:2.0:1788568811.106004:0:15103:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788568811.149038:0:15103:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788568811.149328:0:15103:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788568811.153113:0:15103:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788568811.153537:0:15103:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788568811.154255:0:15103:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788568811.159699:0:15103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 562: rc = 0 00100000:10000000:2.0:1788568811.159856:0:15103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 562: rc = 0 00100000:10000000:2.0:1788568811.159973:0:15103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 562: rc = 0 00100000:10000000:2.0:1788568811.160487:0:15103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 417: rc = 0 00100000:10000000:2.0:1788568811.160765:0:15103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 417: rc = 0 00100000:10000000:2.0:1788568811.161087:0:15103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 417: rc = 0 00100000:10000000:2.0:1788568811.161318:0:15103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 417: rc = 0 00100000:10000000:2.0:1788568811.161597:0:15103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 417: rc = 0 00100000:10000000:2.0:1788568811.161852:0:15103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 417: rc = 0 00000020:00000080:2.0:1788568811.166280:0:15103:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788568811.166299:0:15103:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788568811.166314:0:15103:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x41e82f464b6a1e65 00000020:01000004:2.0:1788568811.166325:0:15103:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788568811.166353:0:15103:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.104@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788568811.166357:0:15103:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788568811.166364:0:15103:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788568811.166370:0:15103:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788568811.166898:0:15103:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9ae281c04d40) 00000020:00000080:2.0:1788568811.166987:0:15103:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1788568811.168123:0:15103:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788568811.171117:0:15103:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788568811.171129:0:15103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788568811.176022:0:15103:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788568811.176036:0:15103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788568811.179942:0:15103:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788568811.179961:0:15103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788568811.185357:0:15103:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788568811.185528:0:15103:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788568811.185534:0:15103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788568811.186491:0:15103:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788568811.186498:0:15103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788568811.207233:0:15103:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788568811.207589:0:15103:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788568811.207595:0:15103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788568811.208897:0:15103:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788568811.208907:0:15103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788568811.210141:0:15103:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788568811.210151:0:15103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788568811.219438:0:15103:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788568811.219643:0:15103:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788568811.219649:0:15103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788568811.220591:0:15103:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788568811.220729:0:15103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788568811.256287:0:15103:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788568811.256484:0:15103:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788568811.256500:0:15103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788568811.257712:0:15103:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788568811.257722:0:15103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788568811.258191:0:15103:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788568811.258214:0:15103:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788568811.258220:0:15103:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.104@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788568811.268017:0:15103:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.104@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788568811.268054:0:15103:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.104@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788568811.268058:0:15103:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788568811.268060:0:15103:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788568811.268061:0:15103:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788568811.268062:0:15103:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788568811.268064:0:15103:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788568811.268065:0:15103:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788568811.268066:0:15103:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788568811.268068:0:15103:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788568811.268069:0:15103:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788568811.268072:0:15103:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788568811.268074:0:15103:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788568811.268076:0:15103:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788568811.268077:0:15103:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788568811.268078:0:15103:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788568811.268079:0:15103:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788568811.268080:0:15103:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788568811.268081:0:15103:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788568811.268082:0:15103:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788568811.268088:0:15103:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788568811.268113:0:15103:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788568811.268134:0:15103:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b564000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15103:1875449976286592:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788568811.268215:0:15103:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568811.268360:0:15103:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae253076f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788568811.268458:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976286592 00000100:00100000:1.0:1788568811.268466:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976286592 00000100:00100000:1.0:1788568811.268565:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788568811.268575:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273ab9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+12:15103:x1875449976286592:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788568811.268602:0:14414:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788568811.268606:0:14414:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788568811.268609:0:14414:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788568811.279374:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273ab9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+12:15103:x1875449976286592:12345-0@lo:253:mount.lustre.0 Request processed in 10784us (11141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568811.279393:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788568811.279550:0:15103:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b564000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15103:1875449976286592:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788568811.279570:0:15103:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788568811.279574:0:15103:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788568811.279576:0:15103:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788568811.279578:0:15103:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788568811.279579:0:15103:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788568811.279580:0:15103:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788568811.279581:0:15103:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788568811.279583:0:15103:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788568811.279585:0:15103:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788568811.279586:0:15103:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788568811.279617:0:15103:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ae281739800 from lustre-OST0000 10000000:01000000:0.0:1788568811.279718:0:15103:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788568811.279722:0:15103:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788568811.279731:0:15103:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ae26fb799c0 local copy 00010000:00010000:0.0:1788568811.279756:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae273b2ce00/0x41e82f464b6a1d5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1d62 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568811.280202:0:15103:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b564000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15103:1875449976286720:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788568811.280251:0:15103:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568811.280350:0:15103:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae253076900 going to sleep for 11 seconds 00000100:00100000:3.0:1788568811.280415:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976286720 00000100:00100000:3.0:1788568811.280424:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976286720 00000100:00100000:3.0:1788568811.280571:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788568811.280582:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273ab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+12:15103:x1875449976286720:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788568811.281150:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273ab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+12:15103:x1875449976286720:12345-0@lo:501:mount.lustre.0 Request processed in 568us (896us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788568811.281159:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788568811.281233:0:15103:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b564000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15103:1875449976286720:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788568811.281312:0:15103:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788568811.281470:0:15103:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788568811.281542:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae273b2ce00/0x41e82f464b6a1d5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1d62 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568811.281562:0:15103:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae273b2ce00/0x41e82f464b6a1d5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1d62 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568811.281589:0:15103:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ae281739800 10000000:01000000:0.0:1788568811.281595:0:15103:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788568811.281600:0:15103:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9ae26fb799c0 10000000:01000000:0.0:1788568811.281602:0:15103:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788568811.281606:0:15103:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9ae26fb799c0 from 1 10000000:01000000:0.0:1788568811.281610:0:15103:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788568811.281713:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae27feabc00/0x41e82f464b6a1e73 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568811.281723:0:15103:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae27feabc00/0x41e82f464b6a1e73 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568811.281733:0:15103:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae27feabc00/0x41e82f464b6a1e73 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568811.281763:0:15103:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b564000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15103:1875449976286848:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788568811.281805:0:15103:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568811.282088:0:15103:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae253076900 going to sleep for 11 seconds 00000100:00100000:1.0:1788568811.282180:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976286848 00000100:00100000:1.0:1788568811.282187:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976286848 00000100:00100000:1.0:1788568811.282313:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788568811.282325:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273ab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+12:15103:x1875449976286848:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788568811.282339:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568811.282357:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae273b2c400/0x41e82f464b6a1e7a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a1e73 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568811.282384:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae273b2c400/0x41e82f464b6a1e7a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a1e73 expref: 13 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568811.282396:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae273b2c400/0x41e82f464b6a1e7a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a1e73 expref: 13 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568811.282406:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2c400, rc 0) 00000100:00100000:1.0:1788568811.282454:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273ab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+13:15103:x1875449976286848:12345-0@lo:101:mount.lustre.0 Request processed in 132us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568811.282461:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788568811.282546:0:15103:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b564000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15103:1875449976286848:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788568811.282562:0:15103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae27feabc00/0x41e82f464b6a1e73 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1e7a expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568811.282571:0:15103:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae27feabc00/0x41e82f464b6a1e73 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a1e7a expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788568811.282594:0:15103:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788568811.282615:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae27feabc00/0x41e82f464b6a1e73 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1e7a expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568811.282642:0:15103:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae27feabc00/0x41e82f464b6a1e73 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1e7a expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788568811.282650:0:15103:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788568811.282654:0:15103:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788568811.282660:0:15103:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788568811.282662:0:15103:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788568811.282681:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b800/0x41e82f464b6a1e81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568811.282688:0:15103:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b800/0x41e82f464b6a1e81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568811.282696:0:15103:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b800/0x41e82f464b6a1e81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568811.282713:0:15103:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15103:1875449976286976:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788568811.282757:0:15103:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568811.283319:0:15103:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27bcfb540 going to sleep for 11 seconds 00000100:00100000:0.0:1788568811.283440:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976286976 00000100:00100000:0.0:1788568811.283447:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976286976 00000100:00100000:0.0:1788568811.283582:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788568811.283592:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273abb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+13:15103:x1875449976286976:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788568811.283603:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568811.283617:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae27feaaa00/0x41e82f464b6a1e88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a1e81 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568811.283663:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae27feaaa00/0x41e82f464b6a1e88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a1e81 expref: 14 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568811.283674:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae27feaaa00/0x41e82f464b6a1e88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a1e81 expref: 14 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568811.283681:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae27feaaa00, rc 0) 00000100:00100000:0.0:1788568811.283727:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273abb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+14:15103:x1875449976286976:12345-0@lo:101:mount.lustre.0 Request processed in 136us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568811.283734:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788568811.283965:0:15103:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15103:1875449976286976:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788568811.283980:0:15103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b800/0x41e82f464b6a1e81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1e88 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568811.283988:0:15103:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b800/0x41e82f464b6a1e81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a1e88 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788568811.285236:0:15103:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788568811.287029:0:15103:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788568811.287615:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788568811.287743:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788568811.287797:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788568811.287919:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788568811.289951:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788568811.290068:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788568811.290192:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788568811.290201:0:15103:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788568811.290428:0:15103:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15103:1875449976287104:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788568811.290724:0:15103:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568811.290855:0:15103:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27bcfbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788568811.291049:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976287104 00000100:00100000:3.0:1788568811.291058:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976287104 00000100:00100000:0.0:1788568811.291373:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788568811.291389:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+14:15103:x1875449976287104:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788568811.292368:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+14:15103:x1875449976287104:12345-0@lo:501:mount.lustre.0 Request processed in 978us (1639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568811.292380:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788568811.292743:0:15103:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15103:1875449976287104:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788568811.292880:0:15103:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15103:1875449976287232:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788568811.293102:0:15103:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568811.293215:0:15103:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27bcfbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788568811.293253:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976287232 00000100:00100000:0.0:1788568811.293318:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976287232 00000100:00100000:0.0:1788568811.293406:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788568811.293416:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+14:15103:x1875449976287232:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788568811.294008:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+14:15103:x1875449976287232:12345-0@lo:503:mount.lustre.0 Request processed in 592us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568811.294244:0:15103:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15103:1875449976287232:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788568811.295695:0:15103:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788568811.295882:0:15103:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15103:1875449976287360:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788568811.296010:0:15103:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568811.296065:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788568811.297151:0:15103:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27bcfbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788568811.297404:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976287360 00000100:00100000:0.0:1788568811.297414:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976287360 00000100:00100000:1.0:1788568811.297483:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788568811.297509:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273ab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+14:15103:x1875449976287360:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788568811.298051:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273ab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+14:15103:x1875449976287360:12345-0@lo:502:mount.lustre.0 Request processed in 544us (2038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568811.298061:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788568811.298271:0:15103:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15103:1875449976287360:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788568811.298758:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788568811.298979:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788568811.299022:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788568811.299073:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788568811.299111:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788568811.299145:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788568811.299212:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788568811.299247:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788568811.299354:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1788568811.299406:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1788568811.299443:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1788568811.299568:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1788568811.299702:0:15103:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15103:1875449976287488:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788568811.299805:0:15103:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568811.300079:0:15103:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27bcfbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788568811.300195:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976287488 00000100:00100000:3.0:1788568811.300205:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976287488 00000100:00100000:3.0:1788568811.300262:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788568811.300274:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273abd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+14:15103:x1875449976287488:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788568811.300767:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273abd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+14:15103:x1875449976287488:12345-0@lo:502:mount.lustre.0 Request processed in 494us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568811.300776:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788568811.301094:0:15103:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15103:1875449976287488:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788568811.301221:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1788568811.301238:0:15103:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1788568811.303040:0:15117:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788568811.303053:0:15117:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788568811.303061:0:15117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568811.303064:0:15117:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788568811.303071:0:15117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788568811.303091:0:15117:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9ae251de4d40) 00000020:00000080:1.0:1788568811.303118:0:15117:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788568811.303124:0:15117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788568811.303207:0:15117:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ae281739800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788568811.303214:0:15117:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788568811.303222:0:15117:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x41e82f464b6a1e96 00010000:00010000:1.0:1788568811.309913:0:15117:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1788568811.311019:0:15117:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1788568811.315234:0:15117:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1788568811.319876:0:15117:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788568811.319896:0:15117:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788568811.319906:0:15117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788568811.319909:0:15117:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788568811.319913:0:15117:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788568811.319916:0:15117:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788568811.319918:0:15117:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788568811.319919:0:15117:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788568811.319921:0:15117:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788568811.319923:0:15117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788568811.319952:0:15117:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788568811.319956:0:15117:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788568811.319959:0:15117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788568811.319961:0:15117:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788568811.319964:0:15117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788568811.319966:0:15117:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788568811.319969:0:15117:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788568811.319971:0:15117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788568811.319973:0:15117:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788568811.322224:0:15117:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788568811.322251:0:15117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788568811.322253:0:15117:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788568811.322263:0:15117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788568811.322402:0:15117:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788568811.322405:0:15117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788568811.322407:0:15117:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788568811.322420:0:15117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1788568811.322797:0:15103:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788568811.322904:0:15103:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788568811.323019:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b800/0x41e82f464b6a1e81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1e88 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568811.323035:0:15103:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b800/0x41e82f464b6a1e81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1e88 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788568811.323062:0:15103:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae281739800 from 1 10000000:01000000:2.0:1788568811.323065:0:15103:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788568811.323115:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b200/0x41e82f464b6a1e9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568811.323125:0:15103:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b200/0x41e82f464b6a1e9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568811.323137:0:15103:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b200/0x41e82f464b6a1e9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568811.323184:0:15103:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15103:1875449976287616:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788568811.323292:0:15103:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568811.323359:0:15103:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27bcfbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788568811.323558:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976287616 00000100:00100000:1.0:1788568811.323568:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976287616 00000100:00100000:1.0:1788568811.323627:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788568811.323637:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273abdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+14:15103:x1875449976287616:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788568811.323653:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568811.323669:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae273b2c800/0x41e82f464b6a1ea4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a1e9d expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568811.323697:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae273b2c800/0x41e82f464b6a1ea4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a1e9d expref: 15 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568811.323709:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae273b2c800/0x41e82f464b6a1ea4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a1e9d expref: 15 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568811.323726:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2c800, rc 0) 00000100:00100000:1.0:1788568811.323788:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273abdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+15:15103:x1875449976287616:12345-0@lo:101:mount.lustre.0 Request processed in 151us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568811.323795:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788568811.325539:0:15103:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15103:1875449976287616:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788568811.325578:0:15103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b200/0x41e82f464b6a1e9d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1ea4 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568811.325594:0:15103:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b200/0x41e82f464b6a1e9d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a1ea4 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788568811.326787:0:15103:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788568811.328188:0:15103:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788568811.328687:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788568811.328739:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788568811.328892:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788568811.328901:0:15103:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788568811.329643:0:15103:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15103:1875449976287744:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788568811.329731:0:15103:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568811.329792:0:15103:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27bcfbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788568811.331544:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976287744 00000100:00100000:1.0:1788568811.331562:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976287744 00000100:00100000:1.0:1788568811.331629:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788568811.331640:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273abec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+15:15103:x1875449976287744:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788568811.332161:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273abec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+15:15103:x1875449976287744:12345-0@lo:501:mount.lustre.0 Request processed in 521us (2427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568811.332170:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788568811.333668:0:15103:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15103:1875449976287744:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788568811.333741:0:15103:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15103:1875449976287872:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788568811.333845:0:15103:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568811.333888:0:15103:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27bcfbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788568811.334104:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976287872 00000100:00100000:0.0:1788568811.334112:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976287872 00000100:00100000:0.0:1788568811.334167:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788568811.334177:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273abc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+15:15103:x1875449976287872:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788568811.334389:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273abc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+15:15103:x1875449976287872:12345-0@lo:503:mount.lustre.0 Request processed in 213us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568811.334397:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788568811.335252:0:15103:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15103:1875449976287872:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788568811.336141:0:15103:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788568811.336252:0:15103:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15103:1875449976288000:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788568811.336332:0:15103:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568811.336384:0:15103:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27bcfbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788568811.336591:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976288000 00000100:00100000:1.0:1788568811.336599:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976288000 00000100:00100000:1.0:1788568811.336724:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788568811.336734:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273abe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+15:15103:x1875449976288000:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788568811.337061:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273abe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+15:15103:x1875449976288000:12345-0@lo:502:mount.lustre.0 Request processed in 328us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568811.337069:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788568811.337224:0:15103:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15103:1875449976288000:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788568811.337785:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788568811.337920:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788568811.338170:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788568811.338208:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788568811.338242:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788568811.338310:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788568811.338351:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788568811.338400:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788568811.338451:0:15103:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15103:1875449976288128:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788568811.338591:0:15103:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568811.338732:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976288128 00000100:00100000:1.0:1788568811.338739:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976288128 00000100:00100000:1.0:1788568811.338912:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788568811.338956:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273abc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+15:15103:x1875449976288128:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788568811.339220:0:15103:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27bcfbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788568811.339561:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273abc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+15:15103:x1875449976288128:12345-0@lo:502:mount.lustre.0 Request processed in 638us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568811.339570:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788568811.339724:0:15103:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15103:1875449976288128:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788568811.340172:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788568811.340190:0:15103:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788568811.341414:0:15121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788568811.341428:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568811.341431:0:15121:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788568811.341441:0:15121:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ae281739800 00000020:00000080:1.0:1788568811.341444:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788568811.341453:0:15121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788568811.341455:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568811.341457:0:15121:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788568811.341459:0:15121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788568811.341461:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568811.341462:0:15121:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788568811.341465:0:15121:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ae281739800 00000020:00000080:1.0:1788568811.341467:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788568811.341642:0:15121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788568811.341647:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568811.341649:0:15121:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788568811.341652:0:15121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788568811.341655:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568811.341656:0:15121:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788568811.341659:0:15121:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ae281739800 00000020:00000080:1.0:1788568811.341661:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788568811.342889:0:15121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788568811.342901:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568811.342903:0:15121:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788568811.342910:0:15121:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788568811.347965:0:15103:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788568811.348018:0:15103:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788568811.348040:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b200/0x41e82f464b6a1e9d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1ea4 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568811.348053:0:15103:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b200/0x41e82f464b6a1e9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1ea4 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788568811.348145:0:15103:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788568811.348148:0:15103:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ae281739800 10000000:01000000:3.0:1788568811.348151:0:15103:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ae281739800 10000000:01000000:3.0:1788568811.348156:0:15103:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788568811.348162:0:15103:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ae281739800 from 1 10000000:01000000:3.0:1788568811.348165:0:15103:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788568811.348215:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae2429df200/0x41e82f464b6a1eab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568811.348224:0:15103:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae2429df200/0x41e82f464b6a1eab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568811.348237:0:15103:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae2429df200/0x41e82f464b6a1eab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568811.348266:0:15103:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273b64000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15103:1875449976288256:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788568811.348355:0:15103:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568811.358668:0:15103:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae253067cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788568811.359802:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976288256 00000100:00100000:3.0:1788568811.359883:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976288256 00000100:00100000:3.0:1788568811.359970:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788568811.359981:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273abf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+15:15103:x1875449976288256:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788568811.360010:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568811.360032:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae2429de600/0x41e82f464b6a1eb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a1eab expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568811.360068:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae2429de600/0x41e82f464b6a1eb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a1eab expref: 16 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568811.360081:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae2429de600/0x41e82f464b6a1eb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a1eab expref: 16 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568811.360091:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429de600, rc 0) 00000100:00100000:3.0:1788568811.360184:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273abf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+16:15103:x1875449976288256:12345-0@lo:101:mount.lustre.0 Request processed in 205us (11828us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568811.360191:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788568811.360269:0:15103:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273b64000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15103:1875449976288256:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788568811.360292:0:15103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae2429df200/0x41e82f464b6a1eab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1eb2 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568811.360303:0:15103:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae2429df200/0x41e82f464b6a1eab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a1eb2 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788568811.362429:0:15103:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788568811.362975:0:15103:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788568811.363247:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788568811.363290:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788568811.363319:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788568811.363361:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788568811.363395:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788568811.363456:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788568811.363502:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788568811.363534:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788568811.363579:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788568811.363616:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788568811.363648:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788568811.363687:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788568811.363715:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788568811.363742:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788568811.363815:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788568811.363846:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788568811.363874:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788568811.363914:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788568811.365441:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788568811.365511:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788568811.365585:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788568811.365787:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788568811.365830:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788568811.365876:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788568811.365907:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788568811.365967:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788568811.366012:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788568811.366042:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1788568811.366130:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788568811.366138:0:15103:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788568811.366271:0:15103:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273b64000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15103:1875449976288384:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788568811.366357:0:15103:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568811.366413:0:15103:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae253067cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788568811.366644:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976288384 00000100:00100000:0.0:1788568811.366653:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976288384 00000100:00100000:0.0:1788568811.366712:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788568811.366723:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273abd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+16:15103:x1875449976288384:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788568811.367073:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273abd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+16:15103:x1875449976288384:12345-0@lo:501:mount.lustre.0 Request processed in 351us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568811.367083:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788568811.370222:0:15103:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273b64000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15103:1875449976288384:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788568811.370301:0:15103:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273b64000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15103:1875449976288512:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788568811.370387:0:15103:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568811.370444:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976288512 00000100:00100000:3.0:1788568811.370462:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976288512 00000100:00100000:3.0:1788568811.370528:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788568811.370539:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273abf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+16:15103:x1875449976288512:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788568811.370795:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273abf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+16:15103:x1875449976288512:12345-0@lo:503:mount.lustre.0 Request processed in 257us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568811.370803:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788568811.372263:0:15103:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae253067cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788568811.372306:0:15103:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273b64000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15103:1875449976288512:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788568811.375406:0:15103:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788568811.377917:0:15103:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273b64000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15103:1875449976288640:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788568811.379163:0:15103:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568811.379223:0:15103:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae253067cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788568811.379311:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976288640 00000100:00100000:0.0:1788568811.379322:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976288640 00000100:00100000:0.0:1788568811.379386:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788568811.379398:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273abfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+16:15103:x1875449976288640:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788568811.381403:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273abfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+16:15103:x1875449976288640:12345-0@lo:502:mount.lustre.0 Request processed in 1997us (2236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568811.381418:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788568811.381998:0:15103:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273b64000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15103:1875449976288640:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788568811.383353:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788568811.383438:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788568811.385467:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788568811.387186:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788568811.387228:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788568811.387280:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788568811.387316:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788568811.387362:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788568811.387412:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788568811.387460:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788568811.388396:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788568811.388488:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788568811.388528:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788568811.388560:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788568811.388646:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788568811.388685:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788568811.388719:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788568811.388782:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788568811.388830:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788568811.388866:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788568811.388918:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788568811.388993:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788568811.389030:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788568811.389077:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788568811.389109:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788568811.389141:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788568811.389187:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788568811.389221:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788568811.389252:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788568811.389320:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788568811.389370:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788568811.389406:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788568811.390089:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788568811.390166:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788568811.390205:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788568811.390271:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788568811.390311:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788568811.390346:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1788568811.390394:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1788568811.390431:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1788568811.390524:0:15103:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15103:1875449976288768:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788568811.390638:0:15103:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568811.390740:0:15103:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae252512c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788568811.392770:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976288768 00000100:00100000:3.0:1788568811.392791:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976288768 00000100:00100000:2.0:1788568811.395572:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788568811.395590:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273abd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+16:15103:x1875449976288768:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788568811.396268:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273abd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+16:15103:x1875449976288768:12345-0@lo:502:mount.lustre.0 Request processed in 677us (5626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568811.396278:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788568811.396373:0:15103:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15103:1875449976288768:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788568811.396703:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788568811.396724:0:15103:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788568811.409302:0:15126:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788568811.409325:0:15126:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9ae273a1cd40) 00000020:00000080:3.0:1788568811.409351:0:15126:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1788568811.409802:0:15126:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ae281739800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788568811.409807:0:15126:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ae281739800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788568811.409810:0:15126:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae281739800 3 00010000:00080000:3.0:1788568811.409858:0:15126:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae27c586000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.104@tcp at head 00010000:00010000:0.0:1788568811.424356:0:15126:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1788568811.424686:0:15126:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788568811.424740:0:15126:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788568811.424771:0:15126:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x41e82f464b6a1ec0 00000100:00080000:0.0:1788568811.424785:0:15126:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788568811.424791:0:15126:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ae27c586000 using connection 192.168.206.104@tcp/0@lo 00000100:00100000:0.0:1788568811.424845:0:15126:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae27b566d80 x1875449976288896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788568811.424890:0:15126:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788568811.425144:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b566d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1875449976288896:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788568811.425262:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568811.425339:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976288896 00000100:00100000:3.0:1788568811.425348:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976288896 00000100:00100000:3.0:1788568811.425383:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788568811.425392:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1875449976288896:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788568811.425419:0:14421:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 445 last 0 00000020:00000080:3.0:1788568811.425458:0:14421:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x41e82f464b6a1ec7 00000004:00100000:3.0:1788568811.425476:0:14421:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788568811.425513:0:14421:0:(import.c:65:import_set_state_nolock()) ffff9ae27c581800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788568811.425566:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875449976288896:12345-0@lo:38:llog_process_th.0 Request processed in 173us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568811.425574:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788568811.425640:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ae27b566d80 x1875449976288896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788568821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568811.425651:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788568811.425660:0:3305:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788568811.425667:0:3305:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788568811.425672:0:3305:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788568811.425674:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ae27c586000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788568811.425680:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b566d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1875449976288896:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788568811.426210:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788568811.426218:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788568811.426220:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788568811.426223:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788568811.426282:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788568811.426295:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875449976289024:0@lo:400:kworker.0 00000100:00100000:2.0:1788568811.426337:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568811.426383:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976289024 00000100:00100000:2.0:1788568811.426388:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976289024 00000100:00100000:2.0:1788568811.426424:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788568811.426432:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875449976289024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568811.426484:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875449976289024:12345-0@lo:400:kworker.0 Request processed in 52us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568811.426491:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788568811.426546:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ae2739f2d80 x1875449976289024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568811.426560:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875449976289024:0@lo:400:kworker.0 00000040:00080000:0.0:1788568811.427346:0:15126:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1788568811.427886:0:15103:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788568811.427920:0:15103:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788568811.428116:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae2429df200/0x41e82f464b6a1eab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1eb2 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568811.428128:0:15103:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae2429df200/0x41e82f464b6a1eab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1eb2 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788568811.428193:0:15103:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788568811.428196:0:15103:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788568811.428197:0:15103:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788568811.428198:0:15103:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788568811.428199:0:15103:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788568811.428201:0:15103:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788568811.428202:0:15103:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788568811.428204:0:15103:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788568811.428206:0:15103:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788568811.428211:0:15103:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788568811.428214:0:15103:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788568811.428215:0:15103:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788568811.428217:0:15103:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788568811.428218:0:15103:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788568811.428232:0:15103:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788568811.428233:0:15103:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788568811.428234:0:15103:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788568811.428235:0:15103:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788568811.428237:0:15103:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788568811.428267:0:15103:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788568811.428289:0:15103:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15103:1875449976289152:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788568811.428360:0:15103:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568811.428414:0:15103:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae244836240 going to sleep for 11 seconds 00000100:00100000:0.0:1788568811.428735:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976289152 00000100:00100000:0.0:1788568811.428755:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976289152 00000100:00100000:0.0:1788568811.428809:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788568811.428828:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273abc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+16:15103:x1875449976289152:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788568811.428859:0:14415:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788568811.428876:0:14415:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788568811.480598:0:14415:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788568811.480613:0:14415:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788568811.480635:0:14437:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788568811.480640:0:14437:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788568811.480665:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ae27feab600/0x41e82f464b6a1ece lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568811.480687:0:14437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae252e7b600/0x41e82f464b6a1e3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a1e34 expref: 16 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568811.480695:0:14437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ae27feab600/0x41e82f464b6a1ece lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568811.480741:0:14437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae252e7b600/0x41e82f464b6a1e3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x41e82f464b6a1e34 expref: 16 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568811.480770:0:14437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae252e7b600/0x41e82f464b6a1e3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x41e82f464b6a1e34 expref: 16 pid: 14416 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568811.480787:0:14437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b564700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14437:1875449976289280:0@lo:104: 00000100:00100000:0.0:1788568811.480867:0:14437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568811.481211:0:14437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae250ae4240 going to sleep for 11 seconds 00000100:00100000:0.0:1788568811.481242:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976289280 00000100:00100000:0.0:1788568811.481251:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976289280 00000100:00100000:0.0:1788568811.481315:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788568811.481326:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b566680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bbee97af-a6b0-4265-8c9f-26b826a76798+3:14437:x1875449976289280:12345-0@lo:104: 00010000:00010000:0.0:1788568811.481342:0:14404:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.104@tcp lock: ffff9ae27feab200/0x41e82f464b6a1e34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a1e3b expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568811.481402:0:14404:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788568811.481408:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b566680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bbee97af-a6b0-4265-8c9f-26b826a76798+3:14437:x1875449976289280:12345-0@lo:104: Request processed in 85us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568811.481415:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788568811.481459:0:14437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b564700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14437:1875449976289280:0@lo:104: 00010000:00010000:0.0:1788568811.481591:0:14437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ae27feab600/0x41e82f464b6a1ece lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568811.481610:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788568811.481616:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae27feab200/0x41e82f464b6a1e34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a1e3b expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568811.481623:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feab200 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:0.0:1788568811.481628:0:14410:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae27feab200/0x41e82f464b6a1e34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x41e82f464b6a1e3b expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568811.481636:0:14410:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae27feab200/0x41e82f464b6a1e34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x41e82f464b6a1e3b expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788568811.481643:0:14410:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae27feab200/0x41e82f464b6a1e34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x41e82f464b6a1e3b expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568811.481660:0:14410:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788568811.481756:0:14410:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae27feab200/0x41e82f464b6a1e34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a1e3b expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568811.481764:0:14410:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788568811.481792:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae27feab200/0x41e82f464b6a1e34 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a1e3b expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568811.481800:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae27feab200/0x41e82f464b6a1e34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a1e3b expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568811.481823:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568811.481825:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568811.481826:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568811.482342:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788568811.482360:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b564700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bbee97af-a6b0-4265-8c9f-26b826a76798:3307:1875449976289408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788568811.482410:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568811.482523:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976289408 00000100:00100000:2.0:1788568811.482531:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976289408 00010000:00010000:2.0:1788568811.482559:0:14408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae252e7b600/0x41e82f464b6a1e3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a1e34 expref: 17 pid: 14416 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568811.482597:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788568811.482604:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b567800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbee97af-a6b0-4265-8c9f-26b826a76798+17:3307:x1875449976289408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788568811.482618:0:14408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568811.482623:0:14408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae252e7b600/0x41e82f464b6a1e3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a1e34 expref: 17 pid: 14416 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568811.482634:0:14408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae252e7b600/0x41e82f464b6a1e3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x41e82f464b6a1e34 expref: 17 pid: 14416 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568811.482650:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae252e7b600/0x41e82f464b6a1e3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x41e82f464b6a1e34 expref: 17 pid: 14416 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568811.482664:0:14408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ae27feab600/0x41e82f464b6a1ece lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568811.482673:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae27feab600/0x41e82f464b6a1ece lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788568811.482688:0:14408:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003595039s 00010000:00010000:2.0:1788568811.482693:0:14408:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae27feab600/0x41e82f464b6a1ece lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568811.482700:0:14408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae27feab600/0x41e82f464b6a1ece lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568811.482708:0:14408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ae27feab600/0x41e82f464b6a1ece lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568811.482721:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ae27feab600/0x41e82f464b6a1ece lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568811.482727:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feab600 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:2.0:1788568811.482731:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ae27feab600/0x41e82f464b6a1ece lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568811.482739:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ae27feab600/0x41e82f464b6a1ece lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568811.482765:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ae27feab600/0x41e82f464b6a1ece lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568811.482776:0:14408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568811.482812:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b567800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbee97af-a6b0-4265-8c9f-26b826a76798+16:3307:x1875449976289408:12345-0@lo:103:ldlm_bl.0 Request processed in 207us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568811.482831:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788568811.483084:0:14437:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ae27feab600/0x41e82f464b6a1ece lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568811.483093:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ae27feab600/0x41e82f464b6a1ece lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568811.483100:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae27feab600/0x41e82f464b6a1ece lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568811.483138:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b564700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bbee97af-a6b0-4265-8c9f-26b826a76798:3307:1875449976289408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788568811.492600:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273abc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+15:15103:x1875449976289152:12345-0@lo:253:mount.lustre.0 Request processed in 63763us (64227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568811.492633:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788568811.492772:0:15103:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15103:1875449976289152:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788568811.492793:0:15103:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788568811.492797:0:15103:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788568811.492799:0:15103:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788568811.492800:0:15103:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788568811.492801:0:15103:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788568811.492802:0:15103:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788568811.492803:0:15103:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788568811.492805:0:15103:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788568811.492822:0:15103:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788568811.492824:0:15103:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788568811.492847:0:15103:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788568811.499775:0:15103:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788568811.500153:0:15103:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788568811.500322:0:15103:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788568811.500467:0:15103:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788568811.500700:0:15103:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788568811.501199:0:15103:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788568811.502041:0:15103:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788568811.628141:0:15103:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788568811.628150:0:15103:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788568811.628187:0:15103:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788568811.628246:0:15103:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.104@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788568811.628272:0:15103:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788568811.628298:0:15103:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788568811.768615:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568812.793043:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788568813.111459:0:14418:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788568813.111467:0:14418:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ae26f783800 from 7 10000000:01000000:1.0:1788568813.111471:0:14418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788568813.111521:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d800/0x41e82f464b6a1ed5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568813.111532:0:14418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d800/0x41e82f464b6a1ed5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568813.111543:0:14418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d800/0x41e82f464b6a1ed5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568813.111568:0:14418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbee97af-a6b0-4265-8c9f-26b826a76798:14418:1875449976289536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788568813.111636:0:14418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568813.111710:0:14418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27906c000 going to sleep for 11 seconds 00000100:00100000:2.0:1788568813.111805:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976289536 00000100:00100000:2.0:1788568813.111812:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976289536 00000100:00100000:2.0:1788568813.111862:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788568813.111871:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273abcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+15:14418:x1875449976289536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788568813.111883:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568813.111896:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae252e7bc00/0x41e82f464b6a1edc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a1ed5 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568813.111918:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae252e7bc00/0x41e82f464b6a1edc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a1ed5 expref: 16 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568813.111977:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae252e7bc00/0x41e82f464b6a1edc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a1ed5 expref: 16 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568813.111987:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7bc00, rc 0) 00000100:00100000:2.0:1788568813.112025:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273abcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+16:14418:x1875449976289536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568813.112031:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788568813.112730:0:14418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbee97af-a6b0-4265-8c9f-26b826a76798:14418:1875449976289536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788568813.112759:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d800/0x41e82f464b6a1ed5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1edc expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568813.112770:0:14418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d800/0x41e82f464b6a1ed5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a1edc expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568813.112834:0:14418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbee97af-a6b0-4265-8c9f-26b826a76798:14418:1875449976289664:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788568813.112873:0:14418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568813.112907:0:14418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27906c000 going to sleep for 11 seconds 00000100:00100000:2.0:1788568813.112968:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976289664 00000100:00100000:2.0:1788568813.112973:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976289664 00000100:00100000:2.0:1788568813.113003:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788568813.113010:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273abf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+16:14418:x1875449976289664:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788568813.113025:0:14415:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788568813.113042:0:14415:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788568813.113045:0:14415:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788568813.113130:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273abf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+16:14418:x1875449976289664:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 120us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568813.113138:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788568813.114355:0:14418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbee97af-a6b0-4265-8c9f-26b826a76798:14418:1875449976289664:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788568813.114436:0:14418:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788568813.114445:0:14418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d800/0x41e82f464b6a1ed5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1edc expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568813.114454:0:14418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d800/0x41e82f464b6a1ed5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1edc expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568813.816069:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568814.841407:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568815.864648:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788568816.635549:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788568816.635559:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788568816.635563:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788568816.635567:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788568816.635595:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788568816.635626:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bbee97af-a6b0-4265-8c9f-26b826a76798:3306:1875449976289792:0@lo:400:kworker.0 00000100:00100000:3.0:1788568816.635679:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273b67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875449976290048:0@lo:400:kworker.0 00000100:00100000:3.0:1788568816.636850:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568816.636965:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788568816.636980:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875449976289920:0@lo:400:kworker.0 00000100:00100000:3.0:1788568816.637030:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568816.637087:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976290048 00000100:00100000:3.0:1788568816.637098:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976290048 00000100:00080000:0.0:1788568816.637182:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788568816.637184:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976289920 00000100:00100000:3.0:1788568816.637191:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976289920 00000100:00100000:3.0:1788568816.637218:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788568816.637227:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875449976290048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568816.637292:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875449976290048:12345-0@lo:400:kworker.0 Request processed in 66us (1508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568816.637311:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788568816.637330:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788568816.637337:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875449976289920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568816.637366:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875449976289920:12345-0@lo:400:kworker.0 Request processed in 31us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568816.637372:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788568816.637410:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae273b67480 x1875449976289920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568816.637426:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875449976289920:0@lo:400:kworker.0 00010000:00080000:3.0:1788568816.637438:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae273b67100 x1875449976290048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568816.637446:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273b67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875449976290048:0@lo:400:kworker.0 00000100:00100000:2.0:1788568816.638383:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568816.638458:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976289792 00000100:00100000:3.0:1788568816.638480:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976289792 00000100:00100000:3.0:1788568816.638534:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788568816.638543:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273abe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+16:3306:x1875449976289792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568816.638613:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273abe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+16:3306:x1875449976289792:12345-0@lo:400:kworker.0 Request processed in 72us (2904us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568816.638621:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788568816.639233:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bbee97af-a6b0-4265-8c9f-26b826a76798:3306:1875449976289792:0@lo:400:kworker.0 00010000:00010000:2.0:1788568816.887669:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568817.913268:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788568818.090623:0:15469:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg604-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788568818.935875:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568819.972484:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788568820.346267:0:14454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788568820.986231:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788568821.753276:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788568821.753285:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788568821.753308:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788568821.753312:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788568821.753378:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bbee97af-a6b0-4265-8c9f-26b826a76798:3306:1875449976290176:0@lo:400:kworker.0 00000100:00100000:2.0:1788568821.753488:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568821.753555:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788568821.753561:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976290304:0@lo:400:kworker.0 00000100:00100000:2.0:1788568821.753592:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568821.753650:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788568821.753660:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875449976290432:0@lo:400:kworker.0 00000100:00100000:2.0:1788568821.753703:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568821.753753:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976290304 00000100:00100000:2.0:1788568821.753762:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976290304 00000100:00100000:2.0:1788568821.753813:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976290432 00000100:00100000:2.0:1788568821.753817:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976290432 00000100:00100000:2.0:1788568821.753850:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788568821.753861:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976290304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568821.753921:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976290304:12345-0@lo:400:kworker.0 Request processed in 62us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568821.753967:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788568821.753998:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788568821.754005:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875449976290432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568821.754040:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875449976290432:12345-0@lo:400:kworker.0 Request processed in 36us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568821.754047:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788568821.754067:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976290176 00000100:00100000:2.0:1788568821.754071:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976290176 00000100:00100000:2.0:1788568821.754106:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788568821.754113:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273abe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+16:3306:x1875449976290176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568821.754146:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273abe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+16:3306:x1875449976290176:12345-0@lo:400:kworker.0 Request processed in 33us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568821.754152:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1788568821.754181:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788568821.754212:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae2739f3100 x1875449976290432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568821.754227:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875449976290432:0@lo:400:kworker.0 00010000:00080000:2.0:1788568821.754256:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae2739f1500 x1875449976290304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568821.754265:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976290304:0@lo:400:kworker.0 00000100:00100000:2.0:1788568821.754275:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bbee97af-a6b0-4265-8c9f-26b826a76798:3306:1875449976290176:0@lo:400:kworker.0 00010000:00010000:0.0:1788568822.007429:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568823.032484:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568823.671011:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788568808/real 1788568808] req@ffff9ae273b67800 x1875449976286208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788568823 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568823.671040:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ae273b67800 x1875449976286208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788568823 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568823.671050:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788568808/real 1788568808] req@ffff9ae273b65c00 x1875449976286336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788568823 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568823.671060:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ae273b65c00 x1875449976286336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788568823 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788568823.671078:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ae273841800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788568823.671104:0:3305:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788568823.671108:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875449976286208:0@lo:8:kworker.0 00000100:00080000:1.0:1788568823.671113:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ae277a7e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788568823.671118:0:3305:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788568823.671120:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273b65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875449976286336:0@lo:8:kworker.0 00000100:00080000:2.0:1788568823.671239:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788568823.671242:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788568823.671245:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ae273841800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788568823.671250:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 443 00000100:00080000:2.0:1788568823.671254:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788568823.671259:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ae273841800 using connection 192.168.206.104@tcp/0@lo 00000100:00100000:2.0:1788568823.671276:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae2739f1500 x1875449976290688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788568823.671294:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788568823.671297:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788568823.671312:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ae277a7e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788568823.671315:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 443 00000100:00080000:2.0:1788568823.671317:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788568823.671321:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ae277a7e800 using connection 192.168.206.104@tcp/0@lo 00000100:00100000:2.0:1788568823.671334:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae2739f3100 x1875449976290816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788568823.671379:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976290944:0@lo:400:kworker.0 00000100:00100000:2.0:1788568823.671432:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568823.671477:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788568823.671483:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875449976291072:0@lo:400:kworker.0 00000100:00100000:2.0:1788568823.671505:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568823.671535:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976290944 00000100:00100000:2.0:1788568823.671541:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976290944 00000100:00100000:2.0:1788568823.671578:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976291072 00000100:00100000:2.0:1788568823.671581:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976291072 00000100:00100000:2.0:1788568823.671603:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788568823.671610:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976290944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568823.671655:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976290944:12345-0@lo:400:kworker.0 Request processed in 45us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568823.671661:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788568823.671676:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788568823.671694:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788568823.671694:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875449976291072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568823.671703:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bbee97af-a6b0-4265-8c9f-26b826a76798:3308:1875449976290560:0@lo:400:kworker.0 00000100:00100000:2.0:1788568823.671721:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875449976291072:12345-0@lo:400:kworker.0 Request processed in 29us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568823.671727:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788568823.671746:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788568823.671748:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788568823.671776:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae2739f1180 x1875449976291072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568823.671788:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875449976291072:0@lo:400:kworker.0 00010000:00080000:2.0:1788568823.671797:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae2739f0000 x1875449976290944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568823.671803:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976290944:0@lo:400:kworker.0 00000100:00100000:1.0:1788568823.671866:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875449976290688:0@lo:8:kworker.0 00000100:00100000:3.0:1788568823.671889:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976290560 00000100:00100000:3.0:1788568823.671893:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976290560 00000100:00100000:1.0:1788568823.671905:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568823.671919:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788568823.671923:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875449976290816:0@lo:8:kworker.0 00000100:00100000:3.0:1788568823.671942:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fb88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+16:3308:x1875449976290560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568823.671964:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568823.671974:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fb88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+16:3308:x1875449976290560:12345-0@lo:400:kworker.0 Request processed in 49us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568823.671980:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788568823.672025:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976290688 00000100:00100000:3.0:1788568823.672029:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976290688 00000100:00100000:3.0:1788568823.672044:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976290816 00000100:00100000:3.0:1788568823.672047:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976290816 00000100:00100000:3.0:1788568823.672058:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788568823.672062:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1875449976290688:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788568823.672084:0:15105:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 458 last 0 00000020:00000080:3.0:1788568823.672115:0:15105:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x41e82f464b6a1ee3 00002000:00100000:3.0:1788568823.672126:0:15105:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9ae27c587000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788568823.672130:0:15105:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788568823.672138:0:15105:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788568823.672439:0:15105:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788568823.672460:0:15105:0:(import.c:65:import_set_state_nolock()) ffff9ae27c580800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788568823.672495:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875449976290688:12345-0@lo:8:kworker.0 Request processed in 432us (589us total) trans 0 rc 0/0 00010000:00080000:1.0:1788568823.672551:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae2739f1500 x1875449976290688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788568843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568823.672560:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788568823.672566:0:3305:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788568823.672572:0:3305:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788568823.672576:0:3305:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788568823.672579:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ae273841800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788568823.672591:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788568823.672595:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875449976290688:0@lo:8:kworker.0 00000004:00080000:1.0:1788568823.672613:0:14443:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788568823.672852:0:14443:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 458080923923ns, next at 0ns, rc = 0 00000004:00080000:1.0:1788568823.677043:0:14444:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:1.0:1788568823.677069:0:14444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14444:1875449976291328:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788568823.677142:0:14444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568823.677318:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788568823.677331:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976291200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788568823.677362:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568823.677402:0:15107:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788568823.677449:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788568823.687365:0:14444:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae253067180 going to sleep for 11 seconds 00000100:00100000:1.0:1788568823.689401:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bbee97af-a6b0-4265-8c9f-26b826a76798:3308:1875449976290560:0@lo:400:kworker.0 00000100:00100000:0.0:1788568823.695969:0:15107:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788568823.696085:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976291328 00000100:00100000:0.0:1788568823.696096:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976291328 00000100:00100000:0.0:1788568823.696169:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788568823.696177:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3305:x1875449976290816:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788568823.696197:0:15107:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788568823.696276:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3305:x1875449976290816:12345-0@lo:8:kworker.0 Request processed in 98us (24310us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788568823.696296:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788568823.696313:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788568823.696319:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14444:x1875449976291328:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788568823.703910:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976291200 00000100:00100000:3.0:1788568823.703924:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976291200 00000100:00100000:3.0:1788568823.703997:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788568823.704007:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b564700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875449976291200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788568823.704040:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788568823.704118:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b564700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875449976291200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (26754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568823.704124:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788568823.704195:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae273aa0000 x1875449976291200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568839 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568823.704215:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976291200:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788568823.713174:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788568823.713223:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ae277a7e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788568823.713230:0:3305:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788568823.713234:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875449976290816:0@lo:8:kworker.0 00002000:00080000:0.0:1788568823.723190:0:15107:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788568823.723203:0:15107:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1788568823.723208:0:15107:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:0.0:1788568823.732920:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788568823.732963:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065f9fe58/0x41e82f464b6a1eea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.732979:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1788568823.732983:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788568823.732989:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065f9fe58/0x41e82f464b6a1eea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.733005:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065f9fe58/0x41e82f464b6a1eea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.733016:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065f9fe58/0x41e82f464b6a1eea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.743952:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065f9fe58/0x41e82f464b6a1eea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.743984:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788568823.744000:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788568823.744020:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065f9fe58/0x41e82f464b6a1eea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.744028:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaac00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788568823.744033:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065f9fe58/0x41e82f464b6a1eea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.744044:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065f9fe58/0x41e82f464b6a1eea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.744063:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065f9fe58/0x41e82f464b6a1eea lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.744070:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065f9fe58/0x41e82f464b6a1eea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.744090:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568823.744092:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568823.744094:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788568823.744710:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788568823.744718:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8e47797/0x41e82f464b6a1ef1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.744730:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1788568823.744735:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788568823.744741:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8e47797/0x41e82f464b6a1ef1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.744765:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8e47797/0x41e82f464b6a1ef1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.744773:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8e47797/0x41e82f464b6a1ef1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.744780:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8e47797/0x41e82f464b6a1ef1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.744805:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788568823.744845:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788568823.744851:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8e47797/0x41e82f464b6a1ef1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.744859:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feabe00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788568823.744862:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8e47797/0x41e82f464b6a1ef1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.744871:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8e47797/0x41e82f464b6a1ef1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.744895:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8e47797/0x41e82f464b6a1ef1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.744903:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8e47797/0x41e82f464b6a1ef1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.744919:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568823.744921:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568823.744923:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788568823.745212:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788568823.745218:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8030429/0x41e82f464b6a1ef8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.745227:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1788568823.745230:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788568823.745234:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8030429/0x41e82f464b6a1ef8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.745242:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8030429/0x41e82f464b6a1ef8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.745250:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8030429/0x41e82f464b6a1ef8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.745268:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8030429/0x41e82f464b6a1ef8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.745287:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788568823.745331:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788568823.745337:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8030429/0x41e82f464b6a1ef8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.745346:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaa400 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788568823.745349:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8030429/0x41e82f464b6a1ef8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.745358:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8030429/0x41e82f464b6a1ef8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.745370:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8030429/0x41e82f464b6a1ef8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.745377:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8030429/0x41e82f464b6a1ef8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.745401:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568823.745403:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568823.745404:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788568823.745659:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788568823.745664:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000be4baef/0x41e82f464b6a1eff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.745673:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1788568823.745675:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788568823.745695:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000be4baef/0x41e82f464b6a1eff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.745705:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000be4baef/0x41e82f464b6a1eff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.745713:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000be4baef/0x41e82f464b6a1eff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.745720:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000be4baef/0x41e82f464b6a1eff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.745739:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788568823.745862:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788568823.745867:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000be4baef/0x41e82f464b6a1eff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.745875:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaa200 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788568823.745879:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000be4baef/0x41e82f464b6a1eff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.745888:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000be4baef/0x41e82f464b6a1eff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.745898:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000be4baef/0x41e82f464b6a1eff lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.745905:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000be4baef/0x41e82f464b6a1eff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.745918:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568823.745920:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568823.745922:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788568823.746124:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788568823.746130:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f892fbaf/0x41e82f464b6a1f06 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.746143:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1788568823.746146:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788568823.746150:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f892fbaf/0x41e82f464b6a1f06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.746158:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f892fbaf/0x41e82f464b6a1f06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.746166:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f892fbaf/0x41e82f464b6a1f06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.746173:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f892fbaf/0x41e82f464b6a1f06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.746192:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788568823.746267:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788568823.746272:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f892fbaf/0x41e82f464b6a1f06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.746291:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaa800 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788568823.746295:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f892fbaf/0x41e82f464b6a1f06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.746303:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f892fbaf/0x41e82f464b6a1f06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.746313:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f892fbaf/0x41e82f464b6a1f06 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.746321:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f892fbaf/0x41e82f464b6a1f06 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.746334:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568823.746336:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568823.746337:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788568823.746598:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788568823.746604:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070274092/0x41e82f464b6a1f0d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.746613:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1788568823.746616:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788568823.746620:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070274092/0x41e82f464b6a1f0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.746628:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070274092/0x41e82f464b6a1f0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.746648:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070274092/0x41e82f464b6a1f0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.746654:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070274092/0x41e82f464b6a1f0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.746688:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788568823.746836:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788568823.746841:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070274092/0x41e82f464b6a1f0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.746848:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feab000 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788568823.746851:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070274092/0x41e82f464b6a1f0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.746860:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070274092/0x41e82f464b6a1f0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.746878:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070274092/0x41e82f464b6a1f0d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.746885:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070274092/0x41e82f464b6a1f0d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.746898:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568823.746900:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568823.746902:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788568823.752657:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788568823.752669:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e176702/0x41e82f464b6a1f14 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.752696:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1788568823.752701:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788568823.752708:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e176702/0x41e82f464b6a1f14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.752723:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e176702/0x41e82f464b6a1f14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.752733:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e176702/0x41e82f464b6a1f14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.752741:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e176702/0x41e82f464b6a1f14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.752779:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788568823.752836:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788568823.752844:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e176702/0x41e82f464b6a1f14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.752852:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feab800 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788568823.752857:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e176702/0x41e82f464b6a1f14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.752866:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e176702/0x41e82f464b6a1f14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.752880:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e176702/0x41e82f464b6a1f14 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.752887:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e176702/0x41e82f464b6a1f14 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.752916:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568823.752918:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568823.752920:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788568823.753219:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788568823.753224:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d33a0434/0x41e82f464b6a1f1b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.753231:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1788568823.753235:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788568823.753238:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d33a0434/0x41e82f464b6a1f1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.753246:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d33a0434/0x41e82f464b6a1f1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.753253:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d33a0434/0x41e82f464b6a1f1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.753259:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d33a0434/0x41e82f464b6a1f1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.753278:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788568823.753295:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788568823.753300:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d33a0434/0x41e82f464b6a1f1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.753308:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaa000 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788568823.753311:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d33a0434/0x41e82f464b6a1f1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.753319:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d33a0434/0x41e82f464b6a1f1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.753330:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d33a0434/0x41e82f464b6a1f1b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.753337:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d33a0434/0x41e82f464b6a1f1b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.753350:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568823.753352:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568823.753353:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788568823.753669:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788568823.753675:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba494502/0x41e82f464b6a1f22 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.753695:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1788568823.753704:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788568823.753708:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba494502/0x41e82f464b6a1f22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.753717:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba494502/0x41e82f464b6a1f22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.753725:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba494502/0x41e82f464b6a1f22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.753732:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba494502/0x41e82f464b6a1f22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.753750:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788568823.753827:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788568823.753832:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba494502/0x41e82f464b6a1f22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.753850:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feab200 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788568823.753854:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba494502/0x41e82f464b6a1f22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.753862:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba494502/0x41e82f464b6a1f22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.753873:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba494502/0x41e82f464b6a1f22 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.753880:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba494502/0x41e82f464b6a1f22 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.753893:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568823.753895:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568823.753897:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788568823.754143:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788568823.754150:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9fd0056/0x41e82f464b6a1f29 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.754158:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1788568823.754161:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788568823.754165:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9fd0056/0x41e82f464b6a1f29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.754174:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9fd0056/0x41e82f464b6a1f29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.754182:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9fd0056/0x41e82f464b6a1f29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.754196:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9fd0056/0x41e82f464b6a1f29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.754217:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788568823.754549:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788568823.754554:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016386026/0x41e82f464b6a1f30 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.754562:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1788568823.754565:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788568823.754569:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016386026/0x41e82f464b6a1f30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.754578:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016386026/0x41e82f464b6a1f30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.754585:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016386026/0x41e82f464b6a1f30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.754592:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016386026/0x41e82f464b6a1f30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.754593:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788568823.754606:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788568823.754610:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9fd0056/0x41e82f464b6a1f29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.754617:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feab600 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788568823.754621:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9fd0056/0x41e82f464b6a1f29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.754630:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9fd0056/0x41e82f464b6a1f29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.754646:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9fd0056/0x41e82f464b6a1f29 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.754654:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9fd0056/0x41e82f464b6a1f29 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.754668:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788568823.754671:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016386026/0x41e82f464b6a1f30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.754687:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaae00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788568823.754691:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016386026/0x41e82f464b6a1f30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.754699:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016386026/0x41e82f464b6a1f30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.754709:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016386026/0x41e82f464b6a1f30 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.754726:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016386026/0x41e82f464b6a1f30 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.754739:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568823.754741:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568823.754747:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568823.754763:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788568823.763218:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788568823.763231:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000038e8fa/0x41e82f464b6a1f37 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.763255:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1788568823.763259:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788568823.763266:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000038e8fa/0x41e82f464b6a1f37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.763279:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000038e8fa/0x41e82f464b6a1f37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.763291:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000038e8fa/0x41e82f464b6a1f37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.763299:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000038e8fa/0x41e82f464b6a1f37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.763316:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788568823.764104:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788568823.764112:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078a00bbe/0x41e82f464b6a1f3e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.764121:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1788568823.764125:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788568823.764129:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078a00bbe/0x41e82f464b6a1f3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.764139:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078a00bbe/0x41e82f464b6a1f3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.764160:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078a00bbe/0x41e82f464b6a1f3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.764167:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078a00bbe/0x41e82f464b6a1f3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.764184:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788568823.766509:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788568823.766524:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf898705/0x41e82f464b6a1f45 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.766539:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1788568823.766543:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788568823.766548:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf898705/0x41e82f464b6a1f45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.766694:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf898705/0x41e82f464b6a1f45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.766708:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf898705/0x41e82f464b6a1f45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.766716:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf898705/0x41e82f464b6a1f45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.766747:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788568823.767161:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788568823.767169:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000038e8fa/0x41e82f464b6a1f37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568823.767177:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feab400 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:2.0:1788568823.767182:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000038e8fa/0x41e82f464b6a1f37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568823.767192:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000038e8fa/0x41e82f464b6a1f37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568823.767209:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000038e8fa/0x41e82f464b6a1f37 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568823.767217:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000038e8fa/0x41e82f464b6a1f37 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568823.767235:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788568823.767238:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078a00bbe/0x41e82f464b6a1f3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568823.767254:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae27feaa600 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:2.0:1788568823.767257:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078a00bbe/0x41e82f464b6a1f3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568823.767264:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078a00bbe/0x41e82f464b6a1f3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568823.767273:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078a00bbe/0x41e82f464b6a1f3e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568823.767279:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078a00bbe/0x41e82f464b6a1f3e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568823.767290:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788568823.767293:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf898705/0x41e82f464b6a1f45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568823.767298:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae240030800 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:2.0:1788568823.767301:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf898705/0x41e82f464b6a1f45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568823.767308:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf898705/0x41e82f464b6a1f45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568823.767316:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf898705/0x41e82f464b6a1f45 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568823.767326:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf898705/0x41e82f464b6a1f45 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568823.767338:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568823.767339:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568823.767341:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788568823.768763:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788568823.768772:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009590e446/0x41e82f464b6a1f4c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.768785:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1788568823.768789:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788568823.769503:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009590e446/0x41e82f464b6a1f4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.769521:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009590e446/0x41e82f464b6a1f4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.769531:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009590e446/0x41e82f464b6a1f4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.769538:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009590e446/0x41e82f464b6a1f4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.769553:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788568823.769835:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788568823.769842:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009590e446/0x41e82f464b6a1f4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568823.769849:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae240031800 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:2.0:1788568823.769854:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009590e446/0x41e82f464b6a1f4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568823.769862:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009590e446/0x41e82f464b6a1f4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568823.769877:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009590e446/0x41e82f464b6a1f4c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568823.769884:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009590e446/0x41e82f464b6a1f4c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568823.769902:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568823.769904:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568823.769905:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568823.775531:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788568823.778015:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788568823.778027:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a781436d/0x41e82f464b6a1f53 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.778044:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1788568823.778056:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788568823.778064:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a781436d/0x41e82f464b6a1f53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.778079:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a781436d/0x41e82f464b6a1f53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.778090:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a781436d/0x41e82f464b6a1f53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.778098:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a781436d/0x41e82f464b6a1f53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.778118:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788568823.778853:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788568823.778861:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a781436d/0x41e82f464b6a1f53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.778870:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae240031000 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788568823.778875:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a781436d/0x41e82f464b6a1f53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.778884:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a781436d/0x41e82f464b6a1f53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.778900:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a781436d/0x41e82f464b6a1f53 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.778908:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a781436d/0x41e82f464b6a1f53 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788568823.778911:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788568823.778916:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc3ca3d0/0x41e82f464b6a1f5a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.778924:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=458s v=(0 0) 00010000:00010000:3.0:1788568823.778940:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568823.778941:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788568823.778942:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568823.778943:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568823.778946:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc3ca3d0/0x41e82f464b6a1f5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.778955:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc3ca3d0/0x41e82f464b6a1f5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.778963:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc3ca3d0/0x41e82f464b6a1f5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.778979:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc3ca3d0/0x41e82f464b6a1f5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.779003:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788568823.779058:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788568823.779063:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc3ca3d0/0x41e82f464b6a1f5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.779071:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae240031e00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788568823.779080:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc3ca3d0/0x41e82f464b6a1f5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.779087:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc3ca3d0/0x41e82f464b6a1f5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.779098:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc3ca3d0/0x41e82f464b6a1f5a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.779105:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc3ca3d0/0x41e82f464b6a1f5a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.779118:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568823.779120:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568823.779122:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788568823.779472:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788568823.779478:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006368d17/0x41e82f464b6a1f61 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.779486:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1788568823.779490:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788568823.779493:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006368d17/0x41e82f464b6a1f61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.779502:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006368d17/0x41e82f464b6a1f61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.779509:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006368d17/0x41e82f464b6a1f61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.779516:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006368d17/0x41e82f464b6a1f61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.779537:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788568823.779597:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788568823.779603:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006368d17/0x41e82f464b6a1f61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.779610:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae240030000 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788568823.779613:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006368d17/0x41e82f464b6a1f61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.779621:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006368d17/0x41e82f464b6a1f61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.779632:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006368d17/0x41e82f464b6a1f61 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.779646:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006368d17/0x41e82f464b6a1f61 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568823.779660:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568823.779661:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568823.779663:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788568823.784137:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788568823.784149:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd8f02d7/0x41e82f464b6a1f68 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.784172:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1788568823.784177:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788568823.784183:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd8f02d7/0x41e82f464b6a1f68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.784197:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd8f02d7/0x41e82f464b6a1f68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.784207:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd8f02d7/0x41e82f464b6a1f68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.784214:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd8f02d7/0x41e82f464b6a1f68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.784248:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788568823.784274:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788568823.784283:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd8f02d7/0x41e82f464b6a1f68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568823.784292:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae240031a00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:2.0:1788568823.784297:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd8f02d7/0x41e82f464b6a1f68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568823.784306:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd8f02d7/0x41e82f464b6a1f68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568823.784323:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd8f02d7/0x41e82f464b6a1f68 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568823.784331:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd8f02d7/0x41e82f464b6a1f68 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568823.784352:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568823.784354:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568823.784357:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788568823.786877:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788568823.786890:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2d1396d/0x41e82f464b6a1f6f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.786906:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1788568823.786910:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788568823.786917:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2d1396d/0x41e82f464b6a1f6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.786947:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2d1396d/0x41e82f464b6a1f6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.788781:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2d1396d/0x41e82f464b6a1f6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.788790:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2d1396d/0x41e82f464b6a1f6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.788836:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788568823.788942:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788568823.788950:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2d1396d/0x41e82f464b6a1f6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568823.788959:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae240030e00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:2.0:1788568823.788964:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2d1396d/0x41e82f464b6a1f6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568823.788987:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2d1396d/0x41e82f464b6a1f6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568823.789018:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2d1396d/0x41e82f464b6a1f6f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568823.789027:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2d1396d/0x41e82f464b6a1f6f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568823.789051:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568823.789054:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568823.789056:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788568823.789437:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788568823.789444:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebd48e69/0x41e82f464b6a1f76 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.789455:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1788568823.789459:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788568823.789465:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebd48e69/0x41e82f464b6a1f76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.789476:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebd48e69/0x41e82f464b6a1f76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.789483:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebd48e69/0x41e82f464b6a1f76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.789490:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebd48e69/0x41e82f464b6a1f76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.789521:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788568823.789587:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788568823.789594:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebd48e69/0x41e82f464b6a1f76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568823.789601:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae240031c00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:2.0:1788568823.789606:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebd48e69/0x41e82f464b6a1f76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568823.789615:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebd48e69/0x41e82f464b6a1f76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568823.789628:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebd48e69/0x41e82f464b6a1f76 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568823.789646:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebd48e69/0x41e82f464b6a1f76 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568823.789661:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568823.789662:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568823.789664:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788568823.792514:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788568823.792524:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006a4be1a/0x41e82f464b6a1f7d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.792541:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1788568823.792545:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788568823.792551:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006a4be1a/0x41e82f464b6a1f7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.792564:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006a4be1a/0x41e82f464b6a1f7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.792574:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006a4be1a/0x41e82f464b6a1f7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.792582:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006a4be1a/0x41e82f464b6a1f7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.792597:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788568823.793521:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788568823.793529:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3ba85f5/0x41e82f464b6a1f84 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.793538:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1788568823.793546:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788568823.793552:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3ba85f5/0x41e82f464b6a1f84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.793562:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3ba85f5/0x41e82f464b6a1f84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.793570:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3ba85f5/0x41e82f464b6a1f84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.793577:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3ba85f5/0x41e82f464b6a1f84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.793594:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788568823.793607:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788568823.793613:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006a4be1a/0x41e82f464b6a1f7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.793620:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae240030200 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788568823.793624:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006a4be1a/0x41e82f464b6a1f7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.793715:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006a4be1a/0x41e82f464b6a1f7d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.793730:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006a4be1a/0x41e82f464b6a1f7d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.793749:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006a4be1a/0x41e82f464b6a1f7d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.793771:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788568823.793775:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3ba85f5/0x41e82f464b6a1f84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.793781:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae253146800 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788568823.793785:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3ba85f5/0x41e82f464b6a1f84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.793793:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3ba85f5/0x41e82f464b6a1f84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.793819:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3ba85f5/0x41e82f464b6a1f84 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.793827:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3ba85f5/0x41e82f464b6a1f84 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.793845:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568823.793847:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568823.793850:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568823.793952:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788568823.794300:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788568823.794306:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050be6b29/0x41e82f464b6a1f8b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.794321:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1788568823.794325:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788568823.794329:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050be6b29/0x41e82f464b6a1f8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.794338:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050be6b29/0x41e82f464b6a1f8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.794347:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050be6b29/0x41e82f464b6a1f8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.794355:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050be6b29/0x41e82f464b6a1f8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.794375:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788568823.795212:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788568823.795221:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050be6b29/0x41e82f464b6a1f8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568823.795230:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae253147c00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:2.0:1788568823.795234:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050be6b29/0x41e82f464b6a1f8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568823.795243:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050be6b29/0x41e82f464b6a1f8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568823.795257:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050be6b29/0x41e82f464b6a1f8b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568823.795264:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050be6b29/0x41e82f464b6a1f8b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568823.795280:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568823.795282:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568823.795298:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788568823.797318:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788568823.797328:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003394eceb/0x41e82f464b6a1f92 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.797342:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1788568823.797346:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788568823.797353:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003394eceb/0x41e82f464b6a1f92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.797365:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003394eceb/0x41e82f464b6a1f92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.797386:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003394eceb/0x41e82f464b6a1f92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.797394:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003394eceb/0x41e82f464b6a1f92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.797409:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788568823.800064:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788568823.800077:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076203ad2/0x41e82f464b6a1f99 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.800094:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1788568823.800098:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788568823.800105:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076203ad2/0x41e82f464b6a1f99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.800119:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076203ad2/0x41e82f464b6a1f99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.800129:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076203ad2/0x41e82f464b6a1f99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.800137:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076203ad2/0x41e82f464b6a1f99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.800171:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788568823.800187:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788568823.800193:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003394eceb/0x41e82f464b6a1f92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.800200:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae253146000 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788568823.800205:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003394eceb/0x41e82f464b6a1f92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.800214:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003394eceb/0x41e82f464b6a1f92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.800229:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003394eceb/0x41e82f464b6a1f92 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.800237:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003394eceb/0x41e82f464b6a1f92 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.800255:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788568823.800258:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076203ad2/0x41e82f464b6a1f99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.800264:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae253146200 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788568823.800268:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076203ad2/0x41e82f464b6a1f99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.800286:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076203ad2/0x41e82f464b6a1f99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.800296:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076203ad2/0x41e82f464b6a1f99 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.800303:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076203ad2/0x41e82f464b6a1f99 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.800316:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568823.800318:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568823.800320:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788568823.806169:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788568823.806182:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c259f62/0x41e82f464b6a1fa0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.806197:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1788568823.806201:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788568823.806208:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c259f62/0x41e82f464b6a1fa0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.806221:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c259f62/0x41e82f464b6a1fa0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.806232:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c259f62/0x41e82f464b6a1fa0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.806250:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c259f62/0x41e82f464b6a1fa0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.806267:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788568823.806280:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788568823.806285:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c259f62/0x41e82f464b6a1fa0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.806292:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae253147600 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788568823.806297:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c259f62/0x41e82f464b6a1fa0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.806306:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c259f62/0x41e82f464b6a1fa0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.806321:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c259f62/0x41e82f464b6a1fa0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.806329:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c259f62/0x41e82f464b6a1fa0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568823.806345:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568823.806347:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568823.806349:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788568823.806621:0:15107:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00010000:00010000:2.0:1788568823.808524:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568823.810849:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14444:x1875449976291328:12345-0@lo:5:osp-pre-0-0.0 Request processed in 114522us (133699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568823.810867:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788568823.810919:0:14444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14444:1875449976291328:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788568823.810948:0:14444:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:0.0:1788568823.810985:0:14444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b564a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14444:1875449976291456:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788568823.811014:0:14444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568823.811048:0:14444:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae248a9f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788568823.811067:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976291456 00000100:00100000:0.0:1788568823.811072:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976291456 00000100:00100000:0.0:1788568823.811103:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788568823.811110:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b565c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14444:x1875449976291456:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788568823.811148:0:15106:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:0.0:1788568823.830276:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b565c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14444:x1875449976291456:12345-0@lo:5:osp-pre-0-0.0 Request processed in 19156us (19251us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788568823.830289:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788568823.832860:0:14444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b564a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14444:1875449976291456:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788568823.832879:0:14444:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000004:00080000:0.0:1788568823.839893:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1788568824.058858:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568825.082287:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788568825.464246:0:15820:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788568825.464249:0:15820:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788568825.464358:0:15820:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ae24de2e800 00000020:01000004:2.0:1788568825.464374:0:15820:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788568825.464386:0:15820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788568825.464412:0:15820:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9ae281c00000) 00000020:00000080:2.0:1788568825.464429:0:15820:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788568825.491383:0:15820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788568825.491732:0:15820:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788568825.492800:0:15820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788568825.493122:0:15820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788568825.493506:0:15820:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788568825.494310:0:15820:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 513: rc = 0 00100000:10000000:2.0:1788568825.494410:0:15820:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 513: rc = 0 00100000:10000000:2.0:1788568825.494762:0:15820:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 513: rc = 0 00100000:10000000:2.0:1788568825.495338:0:15820:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 897: rc = 0 00100000:10000000:2.0:1788568825.495906:0:15820:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 897: rc = 0 00100000:10000000:2.0:1788568825.496874:0:15820:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 897: rc = 0 00100000:10000000:2.0:1788568825.497320:0:15820:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 897: rc = 0 00100000:10000000:2.0:1788568825.497889:0:15820:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 897: rc = 0 00100000:10000000:2.0:1788568825.498332:0:15820:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 897: rc = 0 00000020:00000080:2.0:1788568825.499122:0:15820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788568825.499134:0:15820:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788568825.499218:0:15820:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x41e82f464b6a1fae 00000020:01000004:2.0:1788568825.499228:0:15820:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788568825.499248:0:15820:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.104@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788568825.499252:0:15820:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788568825.499262:0:15820:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788568825.499282:0:15820:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788568825.499287:0:15820:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.104@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788568825.509568:0:15820:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.104@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788568825.509606:0:15820:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.104@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788568825.509610:0:15820:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788568825.509612:0:15820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788568825.509613:0:15820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788568825.509614:0:15820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788568825.509615:0:15820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788568825.509616:0:15820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788568825.509618:0:15820:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788568825.509620:0:15820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788568825.509621:0:15820:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788568825.509624:0:15820:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788568825.509626:0:15820:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788568825.509628:0:15820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788568825.509629:0:15820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788568825.509630:0:15820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788568825.509631:0:15820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788568825.509632:0:15820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788568825.509633:0:15820:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788568825.509634:0:15820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788568825.509634:0:15820:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788568825.509661:0:15820:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788568825.509692:0:15820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15820:1875449976291584:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788568825.509763:0:15820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568825.509881:0:15820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24609cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788568825.512178:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976291584 00000100:00100000:3.0:1788568825.512286:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976291584 00000100:00100000:3.0:1788568825.512348:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788568825.512357:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fb8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+16:15820:x1875449976291584:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788568825.512567:0:14415:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788568825.512570:0:14415:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1788568825.512574:0:14415:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788568825.522868:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fb8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+16:15820:x1875449976291584:12345-0@lo:253:mount.lustre.0 Request processed in 10504us (13096us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568825.522881:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788568825.523019:0:15820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15820:1875449976291584:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788568825.523034:0:15820:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788568825.523037:0:15820:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788568825.523039:0:15820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788568825.523040:0:15820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788568825.523041:0:15820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788568825.523043:0:15820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788568825.523057:0:15820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788568825.523059:0:15820:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788568825.523060:0:15820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788568825.523061:0:15820:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788568825.523079:0:15820:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ae24de2e800 from lustre-OST0001 10000000:01000000:2.0:1788568825.523106:0:15820:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788568825.523109:0:15820:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788568825.523116:0:15820:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ae26fb799c0 local copy 00010000:00010000:2.0:1788568825.523126:0:15820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae273b2ce00/0x41e82f464b6a1d5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1d62 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568825.523323:0:15820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15820:1875449976291712:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788568825.523360:0:15820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568825.523501:0:15820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae248a9f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788568825.523599:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976291712 00000100:00100000:1.0:1788568825.523605:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976291712 00000100:00100000:1.0:1788568825.523692:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788568825.523701:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fb89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+16:15820:x1875449976291712:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788568825.523890:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fb89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+16:15820:x1875449976291712:12345-0@lo:501:mount.lustre.0 Request processed in 189us (529us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788568825.523897:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788568825.523987:0:15820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15820:1875449976291712:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788568825.524001:0:15820:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788568825.524153:0:15820:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788568825.524161:0:15820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae273b2ce00/0x41e82f464b6a1d5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1d62 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568825.524170:0:15820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae273b2ce00/0x41e82f464b6a1d5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1d62 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788568825.524188:0:15820:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ae24de2e800 10000000:01000000:3.0:1788568825.524193:0:15820:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788568825.524197:0:15820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788568825.524199:0:15820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788568825.524209:0:15820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788568825.524212:0:15820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788568825.524233:0:15820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae2429df800/0x41e82f464b6a1fb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568825.524241:0:15820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae2429df800/0x41e82f464b6a1fb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568825.524249:0:15820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae2429df800/0x41e82f464b6a1fb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568825.524264:0:15820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273b67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15820:1875449976291840:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788568825.524294:0:15820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568825.524649:0:15820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae242bb9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788568825.524828:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976291840 00000100:00100000:2.0:1788568825.524834:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976291840 00000100:00100000:2.0:1788568825.524862:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788568825.524869:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fb8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+16:15820:x1875449976291840:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788568825.524878:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568825.524891:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae252e7aa00/0x41e82f464b6a1fbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a1fb5 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568825.524913:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae252e7aa00/0x41e82f464b6a1fbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a1fb5 expref: 17 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568825.524923:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae252e7aa00/0x41e82f464b6a1fbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a1fb5 expref: 17 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568825.524968:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae252e7aa00, rc 0) 00000100:00100000:2.0:1788568825.525003:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fb8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+17:15820:x1875449976291840:12345-0@lo:101:mount.lustre.0 Request processed in 134us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568825.525026:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788568825.525113:0:15820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273b67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15820:1875449976291840:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788568825.525126:0:15820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae2429df800/0x41e82f464b6a1fb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1fbc expref: -99 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568825.525134:0:15820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae2429df800/0x41e82f464b6a1fb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a1fbc expref: -99 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788568825.526231:0:15820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788568825.527498:0:15820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788568825.527902:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788568825.527989:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788568825.528022:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788568825.528063:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788568825.528096:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788568825.528126:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788568825.528274:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788568825.528290:0:15820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788568825.528377:0:15820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273b67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15820:1875449976291968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788568825.528806:0:15820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568825.528847:0:15820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae242bb90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788568825.528961:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976291968 00000100:00100000:2.0:1788568825.528969:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976291968 00000100:00100000:2.0:1788568825.529006:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788568825.529015:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fb8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+17:15820:x1875449976291968:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788568825.529373:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fb8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+17:15820:x1875449976291968:12345-0@lo:501:mount.lustre.0 Request processed in 358us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568825.529381:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788568825.529731:0:15820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273b67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15820:1875449976291968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788568825.529769:0:15820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273b67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15820:1875449976292096:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788568825.529810:0:15820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568825.529841:0:15820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae242bb90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788568825.530506:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976292096 00000100:00100000:2.0:1788568825.530514:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976292096 00000100:00100000:2.0:1788568825.530558:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788568825.530566:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fb89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+17:15820:x1875449976292096:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788568825.531057:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fb89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+17:15820:x1875449976292096:12345-0@lo:503:mount.lustre.0 Request processed in 490us (1245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568825.531065:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788568825.531193:0:15820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273b67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15820:1875449976292096:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788568825.531808:0:15820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788568825.531887:0:15820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15820:1875449976292224:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788568825.531973:0:15820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568825.532003:0:15820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae253067000 going to sleep for 11 seconds 00000100:00100000:2.0:1788568825.532112:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976292224 00000100:00100000:2.0:1788568825.532118:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976292224 00000100:00100000:2.0:1788568825.532152:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788568825.532160:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fb88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+17:15820:x1875449976292224:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788568825.532330:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fb88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+17:15820:x1875449976292224:12345-0@lo:502:mount.lustre.0 Request processed in 170us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568825.532338:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788568825.533922:0:15820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15820:1875449976292224:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788568825.534229:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788568825.534287:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788568825.534318:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788568825.534365:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788568825.534601:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788568825.534748:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788568825.534796:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788568825.534828:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788568825.534869:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1788568825.534905:0:15820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15820:1875449976292352:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788568825.536047:0:15820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568825.536122:0:15820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae253067000 going to sleep for 11 seconds 00000100:00100000:3.0:1788568825.536457:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976292352 00000100:00100000:3.0:1788568825.536466:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976292352 00000100:00100000:3.0:1788568825.536615:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788568825.536626:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fb88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+17:15820:x1875449976292352:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788568825.536846:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fb88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+17:15820:x1875449976292352:12345-0@lo:502:mount.lustre.0 Request processed in 221us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568825.536854:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788568825.536962:0:15820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15820:1875449976292352:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788568825.537061:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1788568825.537074:0:15820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1788568825.538057:0:15822:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788568825.538065:0:15822:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1788568825.538077:0:15822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788568825.538080:0:15822:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788568825.538085:0:15822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788568825.538100:0:15822:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9ae27bbc3380) 00000020:00000080:0.0:1788568825.538122:0:15822:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788568825.538127:0:15822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788568825.538187:0:15822:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ae24de2e800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788568825.538195:0:15822:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788568825.538201:0:15822:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x41e82f464b6a1fca 00010000:00010000:1.0:1788568825.546346:0:15822:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1788568825.546897:0:15822:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1788568825.548759:0:15822:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788568825.550173:0:15822:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788568825.550183:0:15822:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788568825.550189:0:15822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568825.550191:0:15822:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788568825.550194:0:15822:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788568825.550197:0:15822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568825.550199:0:15822:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788568825.550202:0:15822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788568825.550204:0:15822:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788568825.550206:0:15822:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788568825.550208:0:15822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568825.550210:0:15822:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788568825.550212:0:15822:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788568825.550214:0:15822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568825.550216:0:15822:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788568825.550218:0:15822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788568825.550267:0:15822:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788568825.550270:0:15822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568825.550272:0:15822:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788568825.550275:0:15822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1788568825.550413:0:15820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788568825.550438:0:15820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788568825.550459:0:15820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae2429df800/0x41e82f464b6a1fb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1fbc expref: -99 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568825.550483:0:15820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae2429df800/0x41e82f464b6a1fb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1fbc expref: -99 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788568825.550490:0:15820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae24de2e800 from 1 10000000:01000000:2.0:1788568825.550493:0:15820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788568825.550525:0:15820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7ae00/0x41e82f464b6a1fd1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568825.550542:0:15820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae252e7ae00/0x41e82f464b6a1fd1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568825.550553:0:15820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae252e7ae00/0x41e82f464b6a1fd1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568825.550575:0:15820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15820:1875449976292480:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788568825.550633:0:15820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568825.550718:0:15820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae250accd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788568825.550904:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976292480 00000100:00100000:3.0:1788568825.550912:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976292480 00000100:00100000:3.0:1788568825.551047:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788568825.551057:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fb8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+17:15820:x1875449976292480:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788568825.551068:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568825.551080:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae2429dfa00/0x41e82f464b6a1fd8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a1fd1 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568825.551100:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae2429dfa00/0x41e82f464b6a1fd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a1fd1 expref: 18 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568825.551110:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae2429dfa00/0x41e82f464b6a1fd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a1fd1 expref: 18 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568825.551124:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429dfa00, rc 0) 00000100:00100000:3.0:1788568825.551162:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fb8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+18:15820:x1875449976292480:12345-0@lo:101:mount.lustre.0 Request processed in 106us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568825.551168:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788568825.551243:0:15820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15820:1875449976292480:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788568825.551257:0:15820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae252e7ae00/0x41e82f464b6a1fd1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1fd8 expref: -99 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568825.551265:0:15820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae252e7ae00/0x41e82f464b6a1fd1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a1fd8 expref: -99 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788568825.551770:0:15820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788568825.552319:0:15820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788568825.552534:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788568825.552576:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788568825.552644:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788568825.552652:0:15820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788568825.552722:0:15820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15820:1875449976292608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788568825.552767:0:15820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568825.556124:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976292608 00000100:00100000:1.0:1788568825.556137:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976292608 00000100:00100000:1.0:1788568825.556179:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788568825.556187:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fb8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+18:15820:x1875449976292608:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788568825.559003:0:15820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae250accd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788568825.559064:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fb8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+18:15820:x1875449976292608:12345-0@lo:501:mount.lustre.0 Request processed in 2873us (6290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568825.559075:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788568825.559250:0:15820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15820:1875449976292608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788568825.559298:0:15820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15820:1875449976292736:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788568825.559346:0:15820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568825.559375:0:15820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae250accd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788568825.559389:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976292736 00000100:00100000:3.0:1788568825.559456:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976292736 00000100:00100000:3.0:1788568825.559497:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788568825.559507:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fb8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+18:15820:x1875449976292736:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788568825.559842:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fb8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+18:15820:x1875449976292736:12345-0@lo:503:mount.lustre.0 Request processed in 336us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568825.559849:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788568825.560003:0:15820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15820:1875449976292736:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788568825.560855:0:15820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788568825.561025:0:15820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b565500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15820:1875449976292864:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788568825.561117:0:15820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568825.561177:0:15820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2487d3240 going to sleep for 11 seconds 00000100:00100000:1.0:1788568825.561207:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976292864 00000100:00100000:1.0:1788568825.561212:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976292864 00000100:00100000:1.0:1788568825.561291:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788568825.561299:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277a86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+18:15820:x1875449976292864:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788568825.561633:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277a86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+18:15820:x1875449976292864:12345-0@lo:502:mount.lustre.0 Request processed in 334us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568825.561640:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788568825.561734:0:15820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b565500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15820:1875449976292864:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788568825.561957:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788568825.561999:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788568825.562036:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788568825.562077:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788568825.562107:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788568825.562144:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788568825.562171:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788568825.562197:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1788568825.562222:0:15820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b565500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15820:1875449976292992:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788568825.562263:0:15820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568825.562287:0:15820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2487d3240 going to sleep for 11 seconds 00000100:00100000:3.0:1788568825.562592:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976292992 00000100:00100000:3.0:1788568825.562598:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976292992 00000100:00100000:3.0:1788568825.562682:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788568825.562690:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277a86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+18:15820:x1875449976292992:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788568825.562841:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277a86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+18:15820:x1875449976292992:12345-0@lo:502:mount.lustre.0 Request processed in 151us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568825.562847:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788568825.562996:0:15820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b565500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15820:1875449976292992:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788568825.563091:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788568825.563108:0:15820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788568825.564132:0:15826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788568825.564142:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788568825.564144:0:15826:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788568825.564152:0:15826:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ae24de2e800 00000020:00000080:3.0:1788568825.564154:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788568825.564161:0:15826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788568825.564163:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788568825.564164:0:15826:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788568825.564167:0:15826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788568825.564178:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788568825.564180:0:15826:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788568825.564184:0:15826:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ae24de2e800 00000020:00000080:3.0:1788568825.564186:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788568825.564273:0:15826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788568825.564278:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788568825.564279:0:15826:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788568825.564282:0:15826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788568825.564284:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788568825.564286:0:15826:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788568825.564289:0:15826:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ae24de2e800 00000020:00000080:3.0:1788568825.564291:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788568825.568259:0:15826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788568825.568271:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788568825.568272:0:15826:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788568825.568277:0:15826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1788568825.569234:0:15820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788568825.569266:0:15820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788568825.569286:0:15820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae252e7ae00/0x41e82f464b6a1fd1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1fd8 expref: -99 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568825.569299:0:15820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae252e7ae00/0x41e82f464b6a1fd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1fd8 expref: -99 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568825.569345:0:15820:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788568825.569348:0:15820:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ae24de2e800 10000000:01000000:0.0:1788568825.569351:0:15820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ae24de2e800 10000000:01000000:0.0:1788568825.569355:0:15820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788568825.569360:0:15820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ae24de2e800 from 1 10000000:01000000:0.0:1788568825.569362:0:15820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788568825.569474:0:15820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae253146000/0x41e82f464b6a1fdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568825.569483:0:15820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae253146000/0x41e82f464b6a1fdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568825.569494:0:15820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae253146000/0x41e82f464b6a1fdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568825.569518:0:15820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b565500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15820:1875449976293120:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788568825.569647:0:15820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568825.569697:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976293120 00000100:00100000:0.0:1788568825.569703:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976293120 00000100:00100000:0.0:1788568825.569739:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788568825.569747:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+18:15820:x1875449976293120:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788568825.569769:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568825.569780:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae253146800/0x41e82f464b6a1fe6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a1fdf expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568825.569802:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae253146800/0x41e82f464b6a1fe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a1fdf expref: 19 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568825.569812:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae253146800/0x41e82f464b6a1fe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a1fdf expref: 19 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568825.569821:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae253146800, rc 0) 00000100:00100000:0.0:1788568825.569851:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+19:15820:x1875449976293120:12345-0@lo:101:mount.lustre.0 Request processed in 105us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568825.569858:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788568825.569899:0:15820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2523269c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788568825.569920:0:15820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b565500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15820:1875449976293120:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788568825.569956:0:15820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae253146000/0x41e82f464b6a1fdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1fe6 expref: -99 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568825.569966:0:15820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae253146000/0x41e82f464b6a1fdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a1fe6 expref: -99 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788568825.570778:0:15820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1788568825.571271:0:15820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788568825.571701:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788568825.571748:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788568825.571796:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788568825.571854:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788568825.571891:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788568825.571977:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788568825.572016:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788568825.574183:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788568825.574294:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788568825.574334:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788568825.574370:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788568825.575107:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788568825.575155:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788568825.575191:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788568825.575241:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788568825.575277:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788568825.575309:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788568825.575355:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788568825.575612:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788568825.575654:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788568825.575716:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788568825.575750:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788568825.575783:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788568825.575828:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788568825.575860:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1788568825.575890:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1788568825.575972:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1788568825.576010:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1788568825.576044:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1788568825.577512:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1788568825.577635:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1788568825.577679:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1788568825.577716:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1788568825.577759:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1788568825.577814:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1788568825.577858:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1788568825.577893:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1788568825.583640:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1788568825.583662:0:15820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1788568825.583779:0:15820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15820:1875449976293248:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788568825.584047:0:15820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568825.584089:0:15820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae250ac8600 going to sleep for 11 seconds 00000100:00100000:1.0:1788568825.585435:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976293248 00000100:00100000:1.0:1788568825.585446:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976293248 00000100:00100000:1.0:1788568825.585498:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788568825.585508:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277a85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+19:15820:x1875449976293248:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788568825.586543:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277a85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+19:15820:x1875449976293248:12345-0@lo:501:mount.lustre.0 Request processed in 1033us (2492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568825.589620:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788568825.589721:0:15820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15820:1875449976293248:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788568825.589772:0:15820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15820:1875449976293376:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788568825.589835:0:15820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568825.589868:0:15820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae250ac8600 going to sleep for 11 seconds 00000100:00100000:0.0:1788568825.590638:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976293376 00000100:00100000:0.0:1788568825.590654:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976293376 00000100:00100000:0.0:1788568825.590714:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788568825.590723:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+19:15820:x1875449976293376:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788568825.591036:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+19:15820:x1875449976293376:12345-0@lo:503:mount.lustre.0 Request processed in 314us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568825.591044:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788568825.593285:0:15820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15820:1875449976293376:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788568825.596808:0:15820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788568825.596904:0:15820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b565500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15820:1875449976293504:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788568825.597001:0:15820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568825.597037:0:15820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae250af9180 going to sleep for 11 seconds 00000100:00100000:1.0:1788568825.597497:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976293504 00000100:00100000:1.0:1788568825.597504:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976293504 00000100:00100000:1.0:1788568825.597614:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788568825.597624:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277a86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+19:15820:x1875449976293504:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788568825.597962:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277a86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+19:15820:x1875449976293504:12345-0@lo:502:mount.lustre.0 Request processed in 339us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568825.597979:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788568825.598715:0:15820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b565500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15820:1875449976293504:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788568825.599004:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788568825.599057:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788568825.599088:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788568825.599133:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788568825.599820:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788568825.599875:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788568825.599911:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788568825.600012:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788568825.600083:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788568825.600117:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788568825.600161:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788568825.600206:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788568825.600243:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788568825.600272:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788568825.600319:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788568825.600353:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788568825.600413:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788568825.600466:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788568825.600501:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788568825.600733:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788568825.600788:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788568825.600823:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788568825.600851:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788568825.600896:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788568825.600968:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1788568825.601004:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1788568825.601054:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1788568825.601088:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1788568825.601135:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1788568825.601204:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1788568825.601240:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1788568825.601269:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1788568825.601297:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1788568825.601341:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1788568825.601372:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1788568825.601521:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1788568825.601627:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1788568825.601664:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1788568825.601726:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1788568825.601761:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1788568825.601807:0:15820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b565500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15820:1875449976293632:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788568825.601879:0:15820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568825.601991:0:15820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae250af9180 going to sleep for 11 seconds 00000100:00100000:1.0:1788568825.602081:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976293632 00000100:00100000:1.0:1788568825.602087:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976293632 00000100:00100000:1.0:1788568825.602133:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788568825.602149:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277a84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+19:15820:x1875449976293632:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788568825.602346:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277a84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+19:15820:x1875449976293632:12345-0@lo:502:mount.lustre.0 Request processed in 204us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568825.602354:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788568825.602719:0:15820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b565500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15820:1875449976293632:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788568825.602799:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1788568825.602809:0:15820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788568825.603894:0:15831:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788568825.603919:0:15831:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9ae27bbc19c0) 00000020:00000080:0.0:1788568825.604256:0:15831:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1788568825.604323:0:15831:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ae24de2e800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788568825.604328:0:15831:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ae24de2e800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788568825.604330:0:15831:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae24de2e800 3 00010000:00080000:0.0:1788568825.604357:0:15831:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae14335f800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.104@tcp at head 00010000:00010000:0.0:1788568825.606658:0:15831:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1788568825.606863:0:15831:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788568825.606899:0:15831:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788568825.606912:0:15831:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x41e82f464b6a1ff4 00000100:00080000:0.0:1788568825.606922:0:15831:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788568825.606953:0:15831:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ae14335f800 using connection 192.168.206.104@tcp/0@lo 00000100:00100000:0.0:1788568825.606987:0:15831:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae27b565500 x1875449976293760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788568825.607024:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b565500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1875449976293760:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788568825.607105:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568825.609111:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976293760 00000100:00100000:0.0:1788568825.609123:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976293760 00000100:00100000:0.0:1788568825.609255:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788568825.609263:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b565880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3305:x1875449976293760:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788568825.609288:0:14422:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 460 last 0 00000020:00000080:0.0:1788568825.609326:0:14422:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x41e82f464b6a1ffb 00000004:00100000:0.0:1788568825.609342:0:14422:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788568825.609375:0:14422:0:(import.c:65:import_set_state_nolock()) ffff9ae27c7a2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788568825.609644:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b565880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875449976293760:12345-0@lo:38:llog_process_th.0 Request processed in 380us (2538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568825.609652:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788568825.610417:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae27b565500 x1875449976293760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788568835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568825.610429:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788568825.610436:0:3305:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1788568825.610443:0:3305:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788568825.610448:0:3305:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788568825.610451:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ae14335f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788568825.610457:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b565500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1875449976293760:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788568825.612786:0:15831:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788568825.612851:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788568825.612856:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788568825.612859:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ae277a7e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788568825.612866:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 458 00000100:00080000:0.0:1788568825.612872:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788568825.612878:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ae277a7e800 using connection 192.168.206.104@tcp/0@lo 00000100:00100000:0.0:1788568825.612899:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae27b564e00 x1875449976294016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788568825.612975:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b564380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976293888:0@lo:400:kworker.0 00000100:00100000:0.0:1788568825.613035:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568825.613080:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976294144:0@lo:400:kworker.0 00000100:00100000:0.0:1788568825.613104:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568825.613121:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788568825.613126:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b565f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875449976294272:0@lo:400:kworker.0 00000100:00100000:0.0:1788568825.613809:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568825.613849:0:15721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976293888 00000100:00100000:0.0:1788568825.613857:0:15721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976293888 00000100:00100000:0.0:1788568825.613911:0:15721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788568825.613922:0:15721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b567100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3309:x1875449976293888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568825.614004:0:15721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b567100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3309:x1875449976293888:12345-0@lo:400:kworker.0 Request processed in 84us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568825.614010:0:15721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788568825.614033:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976294144 00000100:00100000:0.0:1788568825.614037:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976294144 00000100:00100000:0.0:1788568825.614059:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976294272 00000100:00100000:0.0:1788568825.614070:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976294272 00000100:00100000:0.0:1788568825.614092:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788568825.614097:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b565500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976294144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568825.614132:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b565500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976294144:12345-0@lo:400:kworker.0 Request processed in 35us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568825.614137:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788568825.614159:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788568825.614165:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b566d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875449976294272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568825.614192:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b566d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875449976294272:12345-0@lo:400:kworker.0 Request processed in 28us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568825.614197:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1788568825.614215:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788568825.614219:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788568825.614250:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b564380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976293888:0@lo:400:kworker.0 00010000:00080000:0.0:1788568825.614280:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae27b565f80 x1875449976294272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568825.614290:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b565f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875449976294272:0@lo:400:kworker.0 00010000:00080000:0.0:1788568825.614299:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae27b567b80 x1875449976294144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568825.614306:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976294144:0@lo:400:kworker.0 00000100:00100000:0.0:1788568825.614327:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b564e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875449976294016:0@lo:8:kworker.0 00000100:00100000:0.0:1788568825.614354:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568825.614788:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976294016 00000100:00100000:1.0:1788568825.614794:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976294016 00000100:00100000:1.0:1788568825.614814:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788568825.614820:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b567b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3305:x1875449976294016:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788568825.614869:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b567b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3305:x1875449976294016:12345-0@lo:8:kworker.0 Request processed in 48us (514us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788568825.614876:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788568825.616609:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788568825.616622:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ae277a7e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788568825.616628:0:3305:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788568825.616640:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b564e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875449976294016:0@lo:8:kworker.0 00000040:00080000:0.0:1788568825.616907:0:15831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1788568825.618511:0:15820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788568825.618551:0:15820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788568825.618586:0:15820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae253146000/0x41e82f464b6a1fdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1fe6 expref: -99 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568825.618597:0:15820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae253146000/0x41e82f464b6a1fdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a1fe6 expref: -99 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788568825.618645:0:15820:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788568825.618647:0:15820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788568825.618648:0:15820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788568825.618650:0:15820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788568825.618651:0:15820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788568825.618652:0:15820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788568825.618653:0:15820:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788568825.618655:0:15820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788568825.618656:0:15820:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788568825.618660:0:15820:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788568825.618662:0:15820:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788568825.618663:0:15820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788568825.618664:0:15820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788568825.618665:0:15820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788568825.618666:0:15820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788568825.618677:0:15820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788568825.618679:0:15820:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788568825.618680:0:15820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788568825.618681:0:15820:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788568825.618706:0:15820:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788568825.618724:0:15820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15820:1875449976294400:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788568825.618785:0:15820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568825.618816:0:15820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae250ac8000 going to sleep for 11 seconds 00000100:00100000:0.0:1788568825.618907:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976294400 00000100:00100000:0.0:1788568825.618914:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976294400 00000100:00100000:0.0:1788568825.618984:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788568825.618993:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277a84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+19:15820:x1875449976294400:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788568825.619018:0:14416:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788568825.619031:0:14416:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788568825.653058:0:14416:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788568825.653106:0:14416:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788568825.653857:0:14437:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788568825.653863:0:14437:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788568825.653890:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ae252e7ac00/0x41e82f464b6a2002 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568825.653906:0:14437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae252e7bc00/0x41e82f464b6a1edc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a1ed5 expref: 19 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568825.653914:0:14437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ae252e7ac00/0x41e82f464b6a2002 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568825.653981:0:14437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae252e7bc00/0x41e82f464b6a1edc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x41e82f464b6a1ed5 expref: 19 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568825.653994:0:14437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae252e7bc00/0x41e82f464b6a1edc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x41e82f464b6a1ed5 expref: 19 pid: 14416 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568825.654027:0:14437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f3b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14437:1875449976294528:0@lo:104: 00000100:00100000:2.0:1788568825.654083:0:14437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568825.654116:0:14437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae250acccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788568825.654480:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976294528 00000100:00100000:3.0:1788568825.654488:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976294528 00000100:00100000:3.0:1788568825.654537:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788568825.654546:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bbee97af-a6b0-4265-8c9f-26b826a76798+3:14437:x1875449976294528:12345-0@lo:104: 00010000:00010000:3.0:1788568825.654558:0:14405:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d800/0x41e82f464b6a1ed5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a1edc expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568825.654608:0:14405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788568825.654615:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bbee97af-a6b0-4265-8c9f-26b826a76798+3:14437:x1875449976294528:12345-0@lo:104: Request processed in 70us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568825.654621:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788568825.654712:0:14437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f3b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14437:1875449976294528:0@lo:104: 00010000:00010000:2.0:1788568825.654729:0:14437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ae252e7ac00/0x41e82f464b6a2002 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568825.654803:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788568825.654811:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d800/0x41e82f464b6a1ed5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a1edc expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568825.654818:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2d800 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:0.0:1788568825.654822:0:14409:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d800/0x41e82f464b6a1ed5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x41e82f464b6a1edc expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568825.654830:0:14409:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d800/0x41e82f464b6a1ed5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x41e82f464b6a1edc expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788568825.654836:0:14409:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d800/0x41e82f464b6a1ed5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x41e82f464b6a1edc expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568825.654842:0:14409:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788568825.655054:0:14409:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d800/0x41e82f464b6a1ed5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a1edc expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568825.655061:0:14409:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788568825.655080:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d800/0x41e82f464b6a1ed5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a1edc expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568825.655095:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d800/0x41e82f464b6a1ed5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a1edc expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568825.655109:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568825.655111:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568825.655113:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568825.655119:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788568825.655130:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b564e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bbee97af-a6b0-4265-8c9f-26b826a76798:3309:1875449976294656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788568825.655162:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568825.655194:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976294656 00000100:00100000:0.0:1788568825.655198:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976294656 00010000:00010000:0.0:1788568825.655215:0:14408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae252e7bc00/0x41e82f464b6a1edc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a1ed5 expref: 20 pid: 14416 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568825.655236:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788568825.655242:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b565f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbee97af-a6b0-4265-8c9f-26b826a76798+20:3309:x1875449976294656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788568825.655251:0:14408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568825.655256:0:14408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae252e7bc00/0x41e82f464b6a1edc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a1ed5 expref: 20 pid: 14416 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568825.655266:0:14408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae252e7bc00/0x41e82f464b6a1edc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x41e82f464b6a1ed5 expref: 20 pid: 14416 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568825.655279:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae252e7bc00/0x41e82f464b6a1edc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x41e82f464b6a1ed5 expref: 20 pid: 14416 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568825.655291:0:14408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ae252e7ac00/0x41e82f464b6a2002 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568825.655309:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae252e7ac00/0x41e82f464b6a2002 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788568825.655322:0:14408:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003595039s 00010000:00010000:0.0:1788568825.655327:0:14408:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae252e7ac00/0x41e82f464b6a2002 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568825.655334:0:14408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae252e7ac00/0x41e82f464b6a2002 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568825.655341:0:14408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ae252e7ac00/0x41e82f464b6a2002 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568825.655347:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ae252e7ac00/0x41e82f464b6a2002 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568825.655351:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7ac00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788568825.655355:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ae252e7ac00/0x41e82f464b6a2002 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568825.655362:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ae252e7ac00/0x41e82f464b6a2002 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568825.655377:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ae252e7ac00/0x41e82f464b6a2002 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568825.655385:0:14408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788568825.655490:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b565f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbee97af-a6b0-4265-8c9f-26b826a76798+19:3309:x1875449976294656:12345-0@lo:103:ldlm_bl.0 Request processed in 247us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568825.655496:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788568825.655537:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b564e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bbee97af-a6b0-4265-8c9f-26b826a76798:3309:1875449976294656:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788568825.655556:0:14437:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ae252e7ac00/0x41e82f464b6a2002 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568825.655563:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ae252e7ac00/0x41e82f464b6a2002 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568825.655568:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae252e7ac00/0x41e82f464b6a2002 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568825.662705:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277a84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+18:15820:x1875449976294400:12345-0@lo:253:mount.lustre.0 Request processed in 43705us (43911us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568825.662719:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788568825.662798:0:15820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbee97af-a6b0-4265-8c9f-26b826a76798:15820:1875449976294400:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788568825.662813:0:15820:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788568825.662816:0:15820:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788568825.662818:0:15820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788568825.662820:0:15820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788568825.662821:0:15820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788568825.662837:0:15820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788568825.662838:0:15820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788568825.662840:0:15820:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788568825.662842:0:15820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788568825.662843:0:15820:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788568825.662858:0:15820:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788568825.666806:0:15820:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788568825.667145:0:15820:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788568825.667297:0:15820:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788568825.667455:0:15820:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788568825.667603:0:15820:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788568825.667830:0:15820:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788568825.669165:0:15820:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788568825.735086:0:15820:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788568825.735094:0:15820:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788568825.735127:0:15820:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788568825.735180:0:15820:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.104@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788568825.735192:0:15820:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788568825.735220:0:15820:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788568826.105247:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788568826.987316:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1788568826.987375:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 10000000:01000000:3.0:1788568826.999078:0:14418:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788568826.999088:0:14418:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ae26f783800 from 8 10000000:01000000:3.0:1788568826.999094:0:14418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788568826.999151:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae2429df600/0x41e82f464b6a2009 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568826.999165:0:14418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae2429df600/0x41e82f464b6a2009 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568826.999198:0:14418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae2429df600/0x41e82f464b6a2009 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568826.999229:0:14418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273b67480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbee97af-a6b0-4265-8c9f-26b826a76798:14418:1875449976294784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788568826.999316:0:14418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568826.999386:0:14418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24481f180 going to sleep for 11 seconds 00000100:00100000:0.0:1788568826.999659:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976294784 00000100:00100000:0.0:1788568826.999681:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976294784 00000100:00100000:0.0:1788568826.999740:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788568826.999752:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2817bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+18:14418:x1875449976294784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788568826.999768:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568826.999785:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae253146400/0x41e82f464b6a2010 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a2009 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568826.999812:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae253146400/0x41e82f464b6a2010 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a2009 expref: 19 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568826.999823:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae253146400/0x41e82f464b6a2010 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a2009 expref: 19 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568826.999847:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae253146400, rc 0) 00000100:00100000:0.0:1788568826.999900:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2817bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+19:14418:x1875449976294784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568826.999907:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788568827.000105:0:14418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273b67480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbee97af-a6b0-4265-8c9f-26b826a76798:14418:1875449976294784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788568827.000122:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae2429df600/0x41e82f464b6a2009 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a2010 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568827.000132:0:14418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae2429df600/0x41e82f464b6a2009 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a2010 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568827.000185:0:14418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273b67480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbee97af-a6b0-4265-8c9f-26b826a76798:14418:1875449976294912:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788568827.000218:0:14418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568827.000248:0:14418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24481f180 going to sleep for 11 seconds 00000100:00100000:0.0:1788568827.000298:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976294912 00000100:00100000:0.0:1788568827.000302:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976294912 00000100:00100000:0.0:1788568827.000335:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788568827.000342:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2817bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+19:14418:x1875449976294912:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788568827.000356:0:14416:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788568827.000373:0:14416:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788568827.000376:0:14416:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788568827.000906:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2817bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+19:14418:x1875449976294912:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 562us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568827.000915:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788568827.001376:0:14418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273b67480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbee97af-a6b0-4265-8c9f-26b826a76798:14418:1875449976294912:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788568827.001474:0:14418:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788568827.001484:0:14418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae2429df600/0x41e82f464b6a2009 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a2010 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568827.001494:0:14418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae2429df600/0x41e82f464b6a2009 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a2010 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568827.129751:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568828.151068:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568828.924154:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976295040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788568828.924302:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568828.924390:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976295040 00000100:00100000:3.0:1788568828.924397:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976295040 00000100:00100000:3.0:1788568828.924457:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788568828.924467:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976295040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788568828.924499:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788568828.924542:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976295040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568828.924549:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788568828.924571:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788568828.924603:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788568828.924627:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976295040:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788568829.176051:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568830.200459:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788568830.583672:0:14454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:2.0:1788568830.967169:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788568830.967175:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788568830.967179:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ae277a7e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788568830.967190:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ae277a7e800 using connection 192.168.206.104@tcp/0@lo 00000100:00100000:2.0:1788568830.967208:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae2739f3480 x1875449976295424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788568830.967291:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bbee97af-a6b0-4265-8c9f-26b826a76798:3306:1875449976295168:0@lo:400:kworker.0 00000100:00100000:2.0:1788568830.967351:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568830.967396:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875449976295808:0@lo:400:kworker.0 00000100:00100000:2.0:1788568830.967439:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568830.967463:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788568830.967481:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976295296:0@lo:400:kworker.0 00000100:00100000:2.0:1788568830.967508:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568830.967535:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875449976295424:0@lo:8:kworker.0 00000100:00100000:2.0:1788568830.967558:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568830.967583:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875449976295552:0@lo:400:kworker.0 00000100:00100000:2.0:1788568830.967605:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568830.967623:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788568830.967629:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976295680:0@lo:400:kworker.0 00000100:00100000:2.0:1788568830.967662:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568830.967694:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976295168 00000100:00100000:2.0:1788568830.967702:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976295168 00000100:00100000:2.0:1788568830.967740:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788568830.967748:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2817bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+19:3306:x1875449976295168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568830.967791:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2817bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+19:3306:x1875449976295168:12345-0@lo:400:kworker.0 Request processed in 43us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568830.967798:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788568830.967832:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976295808 00000100:00100000:2.0:1788568830.967835:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976295808 00000100:00100000:2.0:1788568830.967863:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976295552 00000100:00100000:2.0:1788568830.967866:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976295552 00000100:00100000:2.0:1788568830.967876:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976295680 00000100:00100000:2.0:1788568830.967878:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976295680 00000100:00100000:2.0:1788568830.967890:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788568830.967896:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875449976295808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568830.967945:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875449976295808:12345-0@lo:400:kworker.0 Request processed in 31us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568830.967951:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788568830.967969:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788568830.967974:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875449976295552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568830.968005:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875449976295552:12345-0@lo:400:kworker.0 Request processed in 31us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568830.968010:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788568830.968020:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788568830.968025:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976295680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568830.968046:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976295680:12345-0@lo:400:kworker.0 Request processed in 21us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568830.968051:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788568830.968080:0:15721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976295296 00000100:00100000:2.0:1788568830.968083:0:15721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976295296 00000100:00100000:2.0:1788568830.968109:0:15721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976295424 00000100:00100000:2.0:1788568830.968112:0:15721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976295424 00000100:00100000:2.0:1788568830.968124:0:15721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788568830.968130:0:15721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976295296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568830.968158:0:15721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976295296:12345-0@lo:400:kworker.0 Request processed in 29us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568830.968164:0:15721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788568830.968173:0:15721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788568830.968177:0:15721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3305:x1875449976295424:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788568830.968198:0:15721:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 465 last 0 00000020:00000080:2.0:1788568830.968222:0:15721:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x41e82f464b6a2017 00002000:00100000:2.0:1788568830.968234:0:15721:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9ae250a02000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788568830.968238:0:15721:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788568830.968241:0:15721:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788568830.968545:0:15721:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788568830.968568:0:15721:0:(import.c:65:import_set_state_nolock()) ffff9ae250a04800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788568830.968605:0:15721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1875449976295424:12345-0@lo:8:kworker.0 Request processed in 426us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568830.968613:0:15721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788568830.968653:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788568830.968658:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788568830.970352:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae2739f3480 x1875449976295424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788568855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788568830.970371:0:3305:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788568830.970380:0:3305:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788568830.970385:0:3305:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788568830.970388:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ae277a7e800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788568830.970402:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788568830.970407:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875449976295424:0@lo:8:kworker.0 00000004:00080000:2.0:1788568830.970528:0:14446:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:2.0:1788568830.970548:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14446:1875449976296064:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788568830.970591:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568830.970614:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae25042a480 going to sleep for 11 seconds 00000004:00080000:2.0:1788568830.970628:0:14445:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788568830.971013:0:14445:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 465379085752ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788568830.971035:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976295936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788568830.971063:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568830.971098:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976295936 00000100:00100000:2.0:1788568830.971103:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976295936 00000100:00100000:2.0:1788568830.971142:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788568830.971149:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875449976295936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788568830.971178:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788568830.971216:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875449976295936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568830.971223:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788568830.971245:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788568830.971265:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae273aa5f80 x1875449976295936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568846 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568830.971280:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976295936:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788568830.971306:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae2739f2a00 x1875449976295680/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568830.971315:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976295680:0@lo:400:kworker.0 00010000:00080000:2.0:1788568830.971325:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae2739f1c00 x1875449976295552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568830.971333:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875449976295552:0@lo:400:kworker.0 00000100:00100000:2.0:1788568830.971605:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976295296:0@lo:400:kworker.0 00000100:00100000:2.0:1788568830.971616:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bbee97af-a6b0-4265-8c9f-26b826a76798:3306:1875449976295168:0@lo:400:kworker.0 00010000:00080000:2.0:1788568830.971627:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae2739f1180 x1875449976295808/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568830.971636:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875449976295808:0@lo:400:kworker.0 00000100:00100000:2.0:1788568830.971670:0:15721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976296064 00000100:00100000:2.0:1788568830.971674:0:15721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976296064 00000100:00100000:2.0:1788568830.971697:0:15721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788568830.971703:0:15721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14446:x1875449976296064:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788568830.979027:0:15721:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788568830.979825:0:15721:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1788568830.979835:0:15721:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:2.0:1788568830.988554:0:15721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788568830.988565:0:15721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0b2aa0d/0x41e82f464b6a201e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.988582:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1788568830.988587:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788568830.988594:0:15721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0b2aa0d/0x41e82f464b6a201e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.988613:0:15721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0b2aa0d/0x41e82f464b6a201e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.988624:0:15721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0b2aa0d/0x41e82f464b6a201e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.988633:0:15721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0b2aa0d/0x41e82f464b6a201e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.988679:0:15721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788568830.988947:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788568830.988956:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0b2aa0d/0x41e82f464b6a201e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568830.988967:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7b400 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:1.0:1788568830.988972:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0b2aa0d/0x41e82f464b6a201e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568830.988983:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0b2aa0d/0x41e82f464b6a201e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568830.989002:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0b2aa0d/0x41e82f464b6a201e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568830.989010:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0b2aa0d/0x41e82f464b6a201e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568830.989033:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568830.989040:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568830.989042:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788568830.990041:0:15721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788568830.990050:0:15721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067957919/0x41e82f464b6a2025 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.990061:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1788568830.990070:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788568830.990076:0:15721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067957919/0x41e82f464b6a2025 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.990089:0:15721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067957919/0x41e82f464b6a2025 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.990097:0:15721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067957919/0x41e82f464b6a2025 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.990105:0:15721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067957919/0x41e82f464b6a2025 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.990126:0:15721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788568830.990634:0:15721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788568830.990652:0:15721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bac4481/0x41e82f464b6a202c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.990661:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1788568830.990665:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788568830.990669:0:15721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bac4481/0x41e82f464b6a202c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.990679:0:15721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bac4481/0x41e82f464b6a202c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.990688:0:15721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bac4481/0x41e82f464b6a202c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.990701:0:15721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004bac4481/0x41e82f464b6a202c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.990719:0:15721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788568830.990739:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788568830.990744:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067957919/0x41e82f464b6a2025 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.990751:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7be00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:2.0:1788568830.990755:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067957919/0x41e82f464b6a2025 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.990763:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067957919/0x41e82f464b6a2025 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.990778:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067957919/0x41e82f464b6a2025 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.990786:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067957919/0x41e82f464b6a2025 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.990800:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788568830.990804:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004bac4481/0x41e82f464b6a202c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.990820:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7b000 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:2.0:1788568830.990824:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004bac4481/0x41e82f464b6a202c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.990832:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004bac4481/0x41e82f464b6a202c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.990842:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004bac4481/0x41e82f464b6a202c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.990854:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bac4481/0x41e82f464b6a202c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.990869:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568830.990871:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568830.990873:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568830.990907:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788568830.991322:0:15721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788568830.991329:0:15721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007dbf13f1/0x41e82f464b6a2033 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.991338:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1788568830.991342:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788568830.991347:0:15721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007dbf13f1/0x41e82f464b6a2033 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.991357:0:15721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007dbf13f1/0x41e82f464b6a2033 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.991373:0:15721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007dbf13f1/0x41e82f464b6a2033 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.991380:0:15721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007dbf13f1/0x41e82f464b6a2033 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.991399:0:15721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788568830.991482:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788568830.991489:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007dbf13f1/0x41e82f464b6a2033 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568830.991500:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7a600 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:1.0:1788568830.991505:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007dbf13f1/0x41e82f464b6a2033 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568830.991515:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007dbf13f1/0x41e82f464b6a2033 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568830.991528:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007dbf13f1/0x41e82f464b6a2033 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568830.991548:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007dbf13f1/0x41e82f464b6a2033 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568830.991569:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568830.991572:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568830.991573:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788568830.991805:0:15721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788568830.991812:0:15721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000804e410d/0x41e82f464b6a203a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.991820:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1788568830.991823:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788568830.991827:0:15721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000804e410d/0x41e82f464b6a203a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.991837:0:15721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000804e410d/0x41e82f464b6a203a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.991846:0:15721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000804e410d/0x41e82f464b6a203a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.991854:0:15721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000804e410d/0x41e82f464b6a203a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.991887:0:15721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788568830.992358:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788568830.992364:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000804e410d/0x41e82f464b6a203a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568830.992373:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7ac00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:1.0:1788568830.992382:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000804e410d/0x41e82f464b6a203a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568830.992391:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000804e410d/0x41e82f464b6a203a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568830.992403:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000804e410d/0x41e82f464b6a203a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568830.992411:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000804e410d/0x41e82f464b6a203a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568830.992427:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568830.992428:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568830.992430:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788568830.992977:0:15721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788568830.992985:0:15721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abfa10a7/0x41e82f464b6a2041 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.992997:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1788568830.993000:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788568830.993006:0:15721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abfa10a7/0x41e82f464b6a2041 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.993016:0:15721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abfa10a7/0x41e82f464b6a2041 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.993024:0:15721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abfa10a7/0x41e82f464b6a2041 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.993032:0:15721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abfa10a7/0x41e82f464b6a2041 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.993055:0:15721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788568830.993188:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788568830.993194:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abfa10a7/0x41e82f464b6a2041 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568830.993202:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7bc00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:1.0:1788568830.993206:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abfa10a7/0x41e82f464b6a2041 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568830.993216:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abfa10a7/0x41e82f464b6a2041 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568830.993230:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abfa10a7/0x41e82f464b6a2041 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568830.993245:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abfa10a7/0x41e82f464b6a2041 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568830.993264:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568830.993266:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568830.993268:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788568830.993815:0:15721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788568830.993824:0:15721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a8fe12d/0x41e82f464b6a2048 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.993833:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1788568830.993842:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788568830.993847:0:15721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a8fe12d/0x41e82f464b6a2048 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.993857:0:15721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a8fe12d/0x41e82f464b6a2048 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.993865:0:15721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a8fe12d/0x41e82f464b6a2048 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.993871:0:15721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a8fe12d/0x41e82f464b6a2048 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.993892:0:15721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788568830.993967:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788568830.993973:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a8fe12d/0x41e82f464b6a2048 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568830.993982:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7a800 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:1.0:1788568830.993987:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a8fe12d/0x41e82f464b6a2048 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568830.993996:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a8fe12d/0x41e82f464b6a2048 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568830.994010:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a8fe12d/0x41e82f464b6a2048 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568830.994019:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a8fe12d/0x41e82f464b6a2048 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568830.994039:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568830.994042:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568830.994044:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788568830.994567:0:15721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788568830.994573:0:15721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d05415af/0x41e82f464b6a204f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.994582:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1788568830.994585:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788568830.994589:0:15721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d05415af/0x41e82f464b6a204f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.994598:0:15721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d05415af/0x41e82f464b6a204f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.994607:0:15721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d05415af/0x41e82f464b6a204f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.994620:0:15721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d05415af/0x41e82f464b6a204f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.994650:0:15721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788568830.994679:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788568830.994686:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d05415af/0x41e82f464b6a204f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568830.994695:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7b600 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:1.0:1788568830.994699:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d05415af/0x41e82f464b6a204f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568830.994709:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d05415af/0x41e82f464b6a204f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568830.994723:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d05415af/0x41e82f464b6a204f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568830.994730:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d05415af/0x41e82f464b6a204f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568830.994747:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568830.994749:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568830.994750:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788568830.995861:0:15721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788568830.995869:0:15721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b4c401d/0x41e82f464b6a2056 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.995881:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1788568830.995885:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788568830.995890:0:15721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b4c401d/0x41e82f464b6a2056 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.995901:0:15721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b4c401d/0x41e82f464b6a2056 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.995910:0:15721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b4c401d/0x41e82f464b6a2056 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.995918:0:15721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b4c401d/0x41e82f464b6a2056 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.995958:0:15721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788568830.995970:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788568830.995974:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b4c401d/0x41e82f464b6a2056 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.995988:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7a000 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:2.0:1788568830.995992:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b4c401d/0x41e82f464b6a2056 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.996000:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b4c401d/0x41e82f464b6a2056 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.996019:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b4c401d/0x41e82f464b6a2056 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.996027:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b4c401d/0x41e82f464b6a2056 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.996045:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568830.996048:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568830.996049:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788568830.997589:0:15721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788568830.997600:0:15721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c5bfb73/0x41e82f464b6a205d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.997613:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1788568830.997617:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788568830.997622:0:15721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c5bfb73/0x41e82f464b6a205d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.997634:0:15721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c5bfb73/0x41e82f464b6a205d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.997895:0:15721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c5bfb73/0x41e82f464b6a205d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.997904:0:15721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c5bfb73/0x41e82f464b6a205d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.997945:0:15721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788568830.997960:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788568830.997968:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c5bfb73/0x41e82f464b6a205d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568830.997979:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7a200 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788568830.997984:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c5bfb73/0x41e82f464b6a205d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568830.997993:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c5bfb73/0x41e82f464b6a205d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568830.998020:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c5bfb73/0x41e82f464b6a205d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568830.998027:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c5bfb73/0x41e82f464b6a205d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568830.998049:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568830.998051:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568830.998053:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788568830.998511:0:15721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788568830.998629:0:15721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0b2aa0d/0x41e82f464b6a2064 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.998659:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1788568830.998663:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788568830.998668:0:15721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0b2aa0d/0x41e82f464b6a2064 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.998680:0:15721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0b2aa0d/0x41e82f464b6a2064 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.998688:0:15721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0b2aa0d/0x41e82f464b6a2064 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.998695:0:15721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0b2aa0d/0x41e82f464b6a2064 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.998738:0:15721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788568830.999125:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788568830.999142:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0b2aa0d/0x41e82f464b6a2064 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568830.999152:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7b400 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:1.0:1788568830.999156:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0b2aa0d/0x41e82f464b6a2064 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568830.999177:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0b2aa0d/0x41e82f464b6a2064 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788568830.999182:0:15721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788568830.999190:0:15721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041245739/0x41e82f464b6a206b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568830.999192:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0b2aa0d/0x41e82f464b6a2064 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.999206:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1788568830.999209:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0b2aa0d/0x41e82f464b6a2064 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.999213:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788568830.999222:0:15721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041245739/0x41e82f464b6a206b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.999234:0:15721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041245739/0x41e82f464b6a206b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568830.999234:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568830.999238:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568830.999242:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568830.999249:0:15721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041245739/0x41e82f464b6a206b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.999257:0:15721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041245739/0x41e82f464b6a206b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568830.999290:0:15721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788568830.999336:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788568830.999342:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041245739/0x41e82f464b6a206b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568830.999349:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae142d6a600 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:1.0:1788568830.999353:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041245739/0x41e82f464b6a206b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568830.999361:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041245739/0x41e82f464b6a206b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568830.999386:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041245739/0x41e82f464b6a206b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568830.999404:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041245739/0x41e82f464b6a206b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568830.999423:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568830.999425:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568830.999428:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788568831.000149:0:15721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788568831.000156:0:15721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0fc6080/0x41e82f464b6a2072 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.000165:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1788568831.000175:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788568831.000180:0:15721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0fc6080/0x41e82f464b6a2072 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.000192:0:15721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0fc6080/0x41e82f464b6a2072 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.000200:0:15721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0fc6080/0x41e82f464b6a2072 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.000206:0:15721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0fc6080/0x41e82f464b6a2072 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.000223:0:15721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788568831.001140:0:15721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788568831.001148:0:15721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000764fc3f6/0x41e82f464b6a2079 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.001157:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1788568831.001161:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788568831.001165:0:15721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000764fc3f6/0x41e82f464b6a2079 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.001176:0:15721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000764fc3f6/0x41e82f464b6a2079 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.001185:0:15721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000764fc3f6/0x41e82f464b6a2079 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.001198:0:15721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000764fc3f6/0x41e82f464b6a2079 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.001222:0:15721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788568831.001551:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788568831.001559:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0fc6080/0x41e82f464b6a2072 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.001569:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae142d6b400 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788568831.001573:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0fc6080/0x41e82f464b6a2072 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.001582:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0fc6080/0x41e82f464b6a2072 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.001598:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0fc6080/0x41e82f464b6a2072 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.001607:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0fc6080/0x41e82f464b6a2072 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.001655:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788568831.001660:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000764fc3f6/0x41e82f464b6a2079 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.001668:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae142d6ac00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788568831.001673:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000764fc3f6/0x41e82f464b6a2079 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568831.001771:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568831.002028:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000764fc3f6/0x41e82f464b6a2079 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.002042:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000764fc3f6/0x41e82f464b6a2079 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.002049:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000764fc3f6/0x41e82f464b6a2079 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.002083:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568831.002086:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568831.002087:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788568831.002969:0:15721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788568831.002978:0:15721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3da50d2/0x41e82f464b6a2080 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.002990:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1788568831.002994:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788568831.002999:0:15721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3da50d2/0x41e82f464b6a2080 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.003011:0:15721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3da50d2/0x41e82f464b6a2080 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.003019:0:15721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3da50d2/0x41e82f464b6a2080 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.003027:0:15721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3da50d2/0x41e82f464b6a2080 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.003043:0:15721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788568831.003064:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788568831.003072:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3da50d2/0x41e82f464b6a2080 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568831.003082:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae142d6b800 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:1.0:1788568831.003086:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3da50d2/0x41e82f464b6a2080 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568831.003096:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3da50d2/0x41e82f464b6a2080 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568831.003108:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3da50d2/0x41e82f464b6a2080 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568831.003116:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3da50d2/0x41e82f464b6a2080 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568831.003136:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568831.003138:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568831.003147:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788568831.003783:0:15721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788568831.003791:0:15721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090d26618/0x41e82f464b6a2087 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.003807:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1788568831.003811:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788568831.003815:0:15721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090d26618/0x41e82f464b6a2087 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.003826:0:15721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090d26618/0x41e82f464b6a2087 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.003834:0:15721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090d26618/0x41e82f464b6a2087 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.003842:0:15721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090d26618/0x41e82f464b6a2087 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.003856:0:15721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788568831.004317:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788568831.004325:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090d26618/0x41e82f464b6a2087 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.004334:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae142d6a400 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788568831.004346:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090d26618/0x41e82f464b6a2087 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.004357:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090d26618/0x41e82f464b6a2087 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.004387:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090d26618/0x41e82f464b6a2087 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.004396:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090d26618/0x41e82f464b6a2087 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.004415:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568831.004417:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568831.004419:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788568831.004781:0:15721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788568831.004789:0:15721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ca3452d/0x41e82f464b6a208e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.004798:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1788568831.004802:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788568831.004807:0:15721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ca3452d/0x41e82f464b6a208e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.004817:0:15721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ca3452d/0x41e82f464b6a208e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.004839:0:15721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ca3452d/0x41e82f464b6a208e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.004846:0:15721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ca3452d/0x41e82f464b6a208e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.004861:0:15721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788568831.005398:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788568831.005405:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ca3452d/0x41e82f464b6a208e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568831.005415:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae142d6ae00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:1.0:1788568831.005420:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ca3452d/0x41e82f464b6a208e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568831.005430:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ca3452d/0x41e82f464b6a208e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568831.005443:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ca3452d/0x41e82f464b6a208e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568831.005450:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ca3452d/0x41e82f464b6a208e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568831.005464:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568831.005466:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568831.005468:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788568831.006096:0:15721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788568831.006104:0:15721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9745c72/0x41e82f464b6a2095 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.006114:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1788568831.006118:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788568831.006123:0:15721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9745c72/0x41e82f464b6a2095 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.006134:0:15721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9745c72/0x41e82f464b6a2095 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.006142:0:15721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9745c72/0x41e82f464b6a2095 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.006150:0:15721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9745c72/0x41e82f464b6a2095 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.006206:0:15721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788568831.006566:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788568831.006574:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9745c72/0x41e82f464b6a2095 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.006581:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae142d6ba00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788568831.006585:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9745c72/0x41e82f464b6a2095 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.006595:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9745c72/0x41e82f464b6a2095 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.006616:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9745c72/0x41e82f464b6a2095 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.006630:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9745c72/0x41e82f464b6a2095 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.006664:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568831.006667:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568831.006668:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788568831.007004:0:15721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788568831.007011:0:15721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057a39e43/0x41e82f464b6a209c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.007020:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1788568831.007024:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788568831.007028:0:15721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057a39e43/0x41e82f464b6a209c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.007038:0:15721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057a39e43/0x41e82f464b6a209c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.007045:0:15721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057a39e43/0x41e82f464b6a209c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.007052:0:15721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057a39e43/0x41e82f464b6a209c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.007073:0:15721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788568831.007109:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788568831.007116:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057a39e43/0x41e82f464b6a209c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568831.007124:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae142d6b000 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:1.0:1788568831.007128:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057a39e43/0x41e82f464b6a209c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568831.007148:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057a39e43/0x41e82f464b6a209c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568831.007160:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057a39e43/0x41e82f464b6a209c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568831.007167:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057a39e43/0x41e82f464b6a209c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568831.007183:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568831.007186:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568831.007188:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788568831.007989:0:15721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788568831.007997:0:15721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000821043f/0x41e82f464b6a20a3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.008007:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1788568831.008016:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788568831.008021:0:15721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000821043f/0x41e82f464b6a20a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.008033:0:15721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000821043f/0x41e82f464b6a20a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.008042:0:15721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000821043f/0x41e82f464b6a20a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.008050:0:15721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000821043f/0x41e82f464b6a20a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.008065:0:15721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788568831.008124:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788568831.008130:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000821043f/0x41e82f464b6a20a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.008155:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae142d6be00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788568831.008160:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000821043f/0x41e82f464b6a20a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.008170:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000821043f/0x41e82f464b6a20a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.008183:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000821043f/0x41e82f464b6a20a3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.008192:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000821043f/0x41e82f464b6a20a3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.008369:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568831.008371:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568831.008373:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788568831.008547:0:15721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788568831.008553:0:15721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b90501e1/0x41e82f464b6a20aa lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.008562:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1788568831.008564:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788568831.008568:0:15721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b90501e1/0x41e82f464b6a20aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.008576:0:15721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b90501e1/0x41e82f464b6a20aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.008583:0:15721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b90501e1/0x41e82f464b6a20aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.008595:0:15721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b90501e1/0x41e82f464b6a20aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.008621:0:15721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788568831.008738:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788568831.008745:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b90501e1/0x41e82f464b6a20aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.008754:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae142d6a800 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788568831.008758:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b90501e1/0x41e82f464b6a20aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.008766:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b90501e1/0x41e82f464b6a20aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.008779:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b90501e1/0x41e82f464b6a20aa lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.008785:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b90501e1/0x41e82f464b6a20aa lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.008804:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568831.008807:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568831.008810:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788568831.010594:0:15721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788568831.010606:0:15721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020c57a25/0x41e82f464b6a20b1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.010619:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1788568831.010624:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788568831.010629:0:15721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020c57a25/0x41e82f464b6a20b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.010655:0:15721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020c57a25/0x41e82f464b6a20b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.010665:0:15721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020c57a25/0x41e82f464b6a20b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.010672:0:15721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020c57a25/0x41e82f464b6a20b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.010696:0:15721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788568831.010719:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788568831.010727:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020c57a25/0x41e82f464b6a20b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.010737:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae142d6bc00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788568831.010751:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020c57a25/0x41e82f464b6a20b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.010773:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020c57a25/0x41e82f464b6a20b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.010789:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020c57a25/0x41e82f464b6a20b1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.010797:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020c57a25/0x41e82f464b6a20b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.010822:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568831.010826:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568831.010829:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788568831.011235:0:15721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788568831.011242:0:15721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9491ac9/0x41e82f464b6a20b8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.011258:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1788568831.011420:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788568831.011428:0:15721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9491ac9/0x41e82f464b6a20b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.011440:0:15721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9491ac9/0x41e82f464b6a20b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.011449:0:15721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9491ac9/0x41e82f464b6a20b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.011457:0:15721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9491ac9/0x41e82f464b6a20b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.011474:0:15721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1788568831.011529:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:0.0:1788568831.011585:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788568831.011592:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9491ac9/0x41e82f464b6a20b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.011600:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae142d6a000 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788568831.011604:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9491ac9/0x41e82f464b6a20b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.011612:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9491ac9/0x41e82f464b6a20b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.011625:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9491ac9/0x41e82f464b6a20b8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.011658:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9491ac9/0x41e82f464b6a20b8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.011678:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568831.011680:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568831.011682:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788568831.012066:0:15721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788568831.012073:0:15721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007124b029/0x41e82f464b6a20bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.012082:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1788568831.012085:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788568831.012089:0:15721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007124b029/0x41e82f464b6a20bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.012099:0:15721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007124b029/0x41e82f464b6a20bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.012118:0:15721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007124b029/0x41e82f464b6a20bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.012125:0:15721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007124b029/0x41e82f464b6a20bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.012192:0:15721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788568831.012670:0:15721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788568831.012676:0:15721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c49e66ac/0x41e82f464b6a20c6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.012685:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1788568831.012687:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788568831.012691:0:15721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c49e66ac/0x41e82f464b6a20c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.012701:0:15721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c49e66ac/0x41e82f464b6a20c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.012708:0:15721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c49e66ac/0x41e82f464b6a20c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.012715:0:15721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c49e66ac/0x41e82f464b6a20c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568831.012954:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788568831.012960:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007124b029/0x41e82f464b6a20bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568831.012968:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae142d6a200 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:1.0:1788568831.012972:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007124b029/0x41e82f464b6a20bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568831.012982:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007124b029/0x41e82f464b6a20bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568831.012995:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007124b029/0x41e82f464b6a20bf lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568831.013016:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007124b029/0x41e82f464b6a20bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568831.013032:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788568831.013035:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c49e66ac/0x41e82f464b6a20c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568831.013042:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae142d6b600 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:1.0:1788568831.013046:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c49e66ac/0x41e82f464b6a20c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568831.013054:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c49e66ac/0x41e82f464b6a20c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568831.013065:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c49e66ac/0x41e82f464b6a20c6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568831.013072:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568831.013073:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568831.013075:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568831.013389:0:15721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788568831.013396:0:15721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c49e66ac/0x41e82f464b6a20c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.013963:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788568831.014123:0:15721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788568831.014130:0:15721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041f8de65/0x41e82f464b6a20cd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.014140:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1788568831.014143:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788568831.014148:0:15721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041f8de65/0x41e82f464b6a20cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.014158:0:15721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041f8de65/0x41e82f464b6a20cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.014166:0:15721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041f8de65/0x41e82f464b6a20cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.014173:0:15721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041f8de65/0x41e82f464b6a20cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.014195:0:15721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788568831.014516:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788568831.014523:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041f8de65/0x41e82f464b6a20cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.014532:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae142d6b200 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788568831.014536:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041f8de65/0x41e82f464b6a20cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.014546:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041f8de65/0x41e82f464b6a20cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.014559:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041f8de65/0x41e82f464b6a20cd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.014566:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041f8de65/0x41e82f464b6a20cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.014586:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568831.014588:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568831.014597:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788568831.014812:0:15721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788568831.014819:0:15721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007aadeb27/0x41e82f464b6a20d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.014833:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1788568831.014837:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788568831.014841:0:15721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007aadeb27/0x41e82f464b6a20d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.014851:0:15721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007aadeb27/0x41e82f464b6a20d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.014859:0:15721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007aadeb27/0x41e82f464b6a20d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.014867:0:15721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007aadeb27/0x41e82f464b6a20d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.014887:0:15721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788568831.014962:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788568831.014968:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007aadeb27/0x41e82f464b6a20d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.014977:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae142d6aa00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788568831.014980:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007aadeb27/0x41e82f464b6a20d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.014989:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007aadeb27/0x41e82f464b6a20d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.015001:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007aadeb27/0x41e82f464b6a20d4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.015008:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007aadeb27/0x41e82f464b6a20d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568831.015028:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568831.015030:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568831.015032:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788568831.015438:0:15721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788568831.015445:0:15721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090d26618/0x41e82f464b6a20db lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.015453:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1788568831.015456:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788568831.015460:0:15721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090d26618/0x41e82f464b6a20db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.015469:0:15721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090d26618/0x41e82f464b6a20db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.015487:0:15721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090d26618/0x41e82f464b6a20db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.015494:0:15721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090d26618/0x41e82f464b6a20db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568831.015517:0:15721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788568831.015541:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788568831.015548:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090d26618/0x41e82f464b6a20db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568831.015557:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae142d6a400 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788568831.015561:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090d26618/0x41e82f464b6a20db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568831.015570:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090d26618/0x41e82f464b6a20db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568831.015585:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090d26618/0x41e82f464b6a20db lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568831.015605:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568831.015608:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568831.015610:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568831.016218:0:15721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090d26618/0x41e82f464b6a20db lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788568831.016418:0:15721:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:2.0:1788568831.016509:0:15721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14446:x1875449976296064:12345-0@lo:5:osp-pre-1-0.0 Request processed in 44802us (45913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568831.016519:0:15721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788568831.016541:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14446:1875449976296064:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788568831.016558:0:14446:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:3.0:1788568831.016601:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273b67480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14446:1875449976296192:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788568831.016636:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568831.016694:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae141ef3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788568831.016797:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976296192 00000100:00100000:2.0:1788568831.016803:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976296192 00000100:00100000:2.0:1788568831.016850:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788568831.016859:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14446:x1875449976296192:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788568831.016890:0:15107:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1788568831.022774:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14446:x1875449976296192:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5910us (6131us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788568831.022786:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788568831.022853:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273b67480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14446:1875449976296192:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788568831.022869:0:14446:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:1.0:1788568831.229061:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788568831.412345:0:16178:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg604-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788568832.248425:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568833.281028:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568833.576047:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568833.576160:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958473856 00000100:00100000:2.0:1788568833.576170:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958473856 00000100:00100000:2.0:1788568833.576227:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 75 00000100:00100000:2.0:1788568833.576236:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2817bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2360:x1875449958473856:12345-192.168.206.4@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788568833.576262:0:14416:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 54c998a2-cb2f-4cd7-8309-f29c84f83a13@192.168.206.4@tcp t0 exp 0000000000000000 cur 467 last 0 00000020:00000080:2.0:1788568833.576290:0:14416:0:(genops.c:1385:class_connect()) connect: client 54c998a2-cb2f-4cd7-8309-f29c84f83a13, cookie 0x41e82f464b6a20e2 00000100:00080000:2.0:1788568833.576419:0:14416:0:(import.c:65:import_set_state_nolock()) ffff9ae260986800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788568833.576480:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2817bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54c998a2-cb2f-4cd7-8309-f29c84f83a13+5:2360:x1875449958473856:12345-192.168.206.4@tcp:250:mount.lustre.0 Request processed in 243us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568833.576488:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 75 00000100:00100000:0.0:1788568833.579918:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568833.580045:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958473984 00000100:00100000:2.0:1788568833.580065:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958473984 00000100:00100000:2.0:1788568833.580119:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 76 00000100:00100000:2.0:1788568833.580128:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2817bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54c998a2-cb2f-4cd7-8309-f29c84f83a13+5:13761:x1875449958473984:12345-192.168.206.4@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788568833.580145:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568833.580162:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae142d6ae00/0x41e82f464b6a20e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bee8a expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568833.580187:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae142d6ae00/0x41e82f464b6a20e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee8a expref: 6 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568833.580198:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae142d6ae00/0x41e82f464b6a20e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee8a expref: 6 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568833.580208:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae142d6ae00, rc 0) 00000100:00100000:2.0:1788568833.580263:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2817bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54c998a2-cb2f-4cd7-8309-f29c84f83a13+6:13761:x1875449958473984:12345-192.168.206.4@tcp:101:mount.lustre.0 Request processed in 136us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568833.580270:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 76 00000100:00100000:1.0:1788568833.585842:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568833.586279:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958474112 00000100:00100000:0.0:1788568833.586303:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958474112 00000100:00100000:0.0:1788568833.586358:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 77 00000100:00100000:0.0:1788568833.586368:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2817bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54c998a2-cb2f-4cd7-8309-f29c84f83a13+6:13761:x1875449958474112:12345-192.168.206.4@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788568833.587187:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2817bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54c998a2-cb2f-4cd7-8309-f29c84f83a13+6:13761:x1875449958474112:12345-192.168.206.4@tcp:501:mount.lustre.0 Request processed in 816us (1350us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788568833.587196:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 77 00000100:00100000:3.0:1788568833.616224:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568833.626916:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958474240 00000100:00100000:0.0:1788568833.626944:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958474240 00000100:00100000:0.0:1788568833.627012:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 78 00000100:00100000:0.0:1788568833.627023:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2817bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54c998a2-cb2f-4cd7-8309-f29c84f83a13+6:13761:x1875449958474240:12345-192.168.206.4@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788568833.627038:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568833.627065:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae253147c00/0x41e82f464b6a20f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bee91 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568833.627095:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae253147c00/0x41e82f464b6a20f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee91 expref: 7 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568833.627105:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae253147c00/0x41e82f464b6a20f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bee91 expref: 7 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568833.627114:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae253147c00, rc 0) 00000100:00100000:0.0:1788568833.627168:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2817bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54c998a2-cb2f-4cd7-8309-f29c84f83a13+7:13761:x1875449958474240:12345-192.168.206.4@tcp:101:mount.lustre.0 Request processed in 147us (10952us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568833.627174:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 78 00000100:00100000:3.0:1788568833.638686:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568833.638804:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958474368 00000100:00100000:2.0:1788568833.638826:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958474368 00000100:00100000:2.0:1788568833.638892:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 79 00000100:00100000:2.0:1788568833.638902:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2817bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54c998a2-cb2f-4cd7-8309-f29c84f83a13+7:13761:x1875449958474368:12345-192.168.206.4@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788568833.640059:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2817bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54c998a2-cb2f-4cd7-8309-f29c84f83a13+8:13761:x1875449958474368:12345-192.168.206.4@tcp:501:mount.lustre.0 Request processed in 305us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568833.640071:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 79 00000100:00100000:1.0:1788568833.649509:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568833.649820:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958474496 00000100:00100000:2.0:1788568833.649829:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958474496 00000100:00100000:2.0:1788568833.649884:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 80 00000100:00100000:2.0:1788568833.649894:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2817bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54c998a2-cb2f-4cd7-8309-f29c84f83a13+8:13761:x1875449958474496:12345-192.168.206.4@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788568833.650129:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2817bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54c998a2-cb2f-4cd7-8309-f29c84f83a13+8:13761:x1875449958474496:12345-192.168.206.4@tcp:503:mount.lustre.0 Request processed in 235us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568833.650137:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 80 00000100:00100000:2.0:1788568833.660754:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568833.660835:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958474624 00000100:00100000:0.0:1788568833.660847:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958474624 00000100:00100000:0.0:1788568833.660893:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 81 00000100:00100000:0.0:1788568833.660902:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2817bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54c998a2-cb2f-4cd7-8309-f29c84f83a13+8:13780:x1875449958474624:12345-192.168.206.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788568833.670104:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2817bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54c998a2-cb2f-4cd7-8309-f29c84f83a13+8:13780:x1875449958474624:12345-192.168.206.4@tcp:502:llog_process_th.0 Request processed in 9193us (9349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568833.670128:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 81 00000100:00100000:3.0:1788568833.715613:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568833.716438:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958474752 00000100:00100000:2.0:1788568833.716449:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958474752 00000100:00100000:2.0:1788568833.716499:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 82 00000100:00100000:2.0:1788568833.716508:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2817be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54c998a2-cb2f-4cd7-8309-f29c84f83a13+8:13780:x1875449958474752:12345-192.168.206.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788568833.717020:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2817be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54c998a2-cb2f-4cd7-8309-f29c84f83a13+8:13780:x1875449958474752:12345-192.168.206.4@tcp:502:llog_process_th.0 Request processed in 511us (1413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568833.717030:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 82 00000100:00100000:3.0:1788568833.723824:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568833.724209:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958474880 00000100:00100000:0.0:1788568833.724219:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958474880 00000100:00100000:0.0:1788568833.724264:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 83 00000100:00100000:0.0:1788568833.724273:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2817bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54c998a2-cb2f-4cd7-8309-f29c84f83a13+8:13761:x1875449958474880:12345-192.168.206.4@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788568833.724288:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568833.724304:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae253147600/0x41e82f464b6a20f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beebb expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568833.724329:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae253147600/0x41e82f464b6a20f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beebb expref: 9 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568833.724339:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae253147600/0x41e82f464b6a20f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beebb expref: 9 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568833.724347:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae253147600, rc 0) 00000100:00100000:0.0:1788568833.724406:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2817bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54c998a2-cb2f-4cd7-8309-f29c84f83a13+9:13761:x1875449958474880:12345-192.168.206.4@tcp:101:mount.lustre.0 Request processed in 133us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568833.724413:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 83 00000100:00100000:3.0:1788568833.735441:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568833.735757:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958475008 00000100:00100000:0.0:1788568833.735768:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958475008 00000100:00100000:0.0:1788568833.735823:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 84 00000100:00100000:0.0:1788568833.735835:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2817be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54c998a2-cb2f-4cd7-8309-f29c84f83a13+9:13761:x1875449958475008:12345-192.168.206.4@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788568833.735858:0:14414:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788568833.735879:0:14414:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788568833.735883:0:14414:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788568833.735887:0:14414:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788568833.735889:0:14414:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1788568833.737906:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2817be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54c998a2-cb2f-4cd7-8309-f29c84f83a13+9:13761:x1875449958475008:12345-192.168.206.4@tcp:256:mount.lustre.0 Request processed in 2064us (2464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568833.737918:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 84 00000100:00100000:0.0:1788568833.742225:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568833.743330:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958475136 00000100:00100000:3.0:1788568833.743341:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958475136 00000100:00100000:3.0:1788568833.743418:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 85 00000100:00100000:3.0:1788568833.743429:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273ab9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54c998a2-cb2f-4cd7-8309-f29c84f83a13+9:13761:x1875449958475136:12345-192.168.206.4@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788568833.743444:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568833.743460:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae2429dec00/0x41e82f464b6a20fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beec2 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568833.743488:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae2429dec00/0x41e82f464b6a20fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beec2 expref: 10 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568833.743521:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae2429dec00/0x41e82f464b6a20fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beec2 expref: 10 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568833.743530:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429dec00, rc 0) 00000100:00100000:3.0:1788568833.743586:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273ab9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54c998a2-cb2f-4cd7-8309-f29c84f83a13+10:13761:x1875449958475136:12345-192.168.206.4@tcp:101:mount.lustre.0 Request processed in 159us (1368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568833.743593:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 85 00000100:00100000:0.0:1788568833.747640:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568833.747740:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958475264 00000100:00100000:2.0:1788568833.747749:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958475264 00000100:00100000:2.0:1788568833.747802:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 86 00000100:00100000:2.0:1788568833.747814:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273abac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54c998a2-cb2f-4cd7-8309-f29c84f83a13+10:13761:x1875449958475264:12345-192.168.206.4@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788568833.748187:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273abac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54c998a2-cb2f-4cd7-8309-f29c84f83a13+10:13761:x1875449958475264:12345-192.168.206.4@tcp:501:mount.lustre.0 Request processed in 375us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568833.748196:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 86 00000100:00100000:0.0:1788568833.752414:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568833.753844:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958475392 00000100:00100000:3.0:1788568833.753857:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958475392 00000100:00100000:3.0:1788568833.753920:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 87 00000100:00100000:3.0:1788568833.753947:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273ab8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54c998a2-cb2f-4cd7-8309-f29c84f83a13+10:13761:x1875449958475392:12345-192.168.206.4@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788568833.754180:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273ab8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54c998a2-cb2f-4cd7-8309-f29c84f83a13+10:13761:x1875449958475392:12345-192.168.206.4@tcp:503:mount.lustre.0 Request processed in 235us (1773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568833.754187:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 87 00000100:00100000:3.0:1788568833.756595:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568833.756767:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958475520 00000100:00100000:1.0:1788568833.756776:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958475520 00000100:00100000:1.0:1788568833.756831:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 88 00000100:00100000:1.0:1788568833.756840:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54c998a2-cb2f-4cd7-8309-f29c84f83a13+10:13784:x1875449958475520:12345-192.168.206.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788568833.757115:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54c998a2-cb2f-4cd7-8309-f29c84f83a13+10:13784:x1875449958475520:12345-192.168.206.4@tcp:502:llog_process_th.0 Request processed in 275us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568833.757123:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 88 00000100:00100000:0.0:1788568833.763077:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568833.763158:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958475648 00000100:00100000:3.0:1788568833.763167:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958475648 00000100:00100000:3.0:1788568833.763220:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 89 00000100:00100000:3.0:1788568833.763231:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273ab8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54c998a2-cb2f-4cd7-8309-f29c84f83a13+10:13784:x1875449958475648:12345-192.168.206.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788568833.763697:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273ab8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54c998a2-cb2f-4cd7-8309-f29c84f83a13+10:13784:x1875449958475648:12345-192.168.206.4@tcp:502:llog_process_th.0 Request processed in 467us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568833.763721:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 89 00000100:00100000:0.0:1788568833.780426:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568833.780586:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958475776 00000100:00100000:2.0:1788568833.780596:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958475776 00000100:00100000:2.0:1788568833.780650:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 4 00000100:00100000:2.0:1788568833.780658:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b564e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2360:x1875449958475776:12345-192.168.206.4@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788568833.780684:0:14423:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from bf0a011c-1a89-4994-b3cd-fb988f4b42d4@192.168.206.4@tcp t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:2.0:1788568833.780729:0:14423:0:(genops.c:1385:class_connect()) connect: client bf0a011c-1a89-4994-b3cd-fb988f4b42d4, cookie 0x41e82f464b6a2105 00000004:00100000:2.0:1788568833.780756:0:14423:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788568833.780762:0:14423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1788568833.851005:0:14423:0:(import.c:65:import_set_state_nolock()) ffff9ae27913e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788568833.851074:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b564e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+6:2360:x1875449958475776:12345-192.168.206.4@tcp:38:mount.lustre.0 Request processed in 70414us (70655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568833.851085:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 4 00000100:00100000:0.0:1788568833.859483:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568833.859696:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958475904 00000100:00100000:2.0:1788568833.859706:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958475904 00000100:00100000:2.0:1788568833.859794:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 5 00000100:00100000:2.0:1788568833.859805:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b564380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+6:0:x1875449958475904:12345-192.168.206.4@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788568833.859843:0:14422:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788568833.859958:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b564380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+6:0:x1875449958475904:12345-192.168.206.4@tcp:41:mount.lustre.0 Request processed in 155us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568833.859966:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 5 00000100:00080000:0.0:1788568833.860096:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788568833.865345:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568833.866597:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958476032 00000100:00100000:2.0:1788568833.866608:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958476032 00000100:00100000:2.0:1788568833.866681:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 6 00000100:00100000:2.0:1788568833.866691:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+6:13761:x1875449958476032:12345-192.168.206.4@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788568833.866725:0:14423:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788568833.867086:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+6:13761:x1875449958476032:12345-192.168.206.4@tcp:41:mount.lustre.0 Request processed in 395us (1748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568833.867094:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 6 00000100:00100000:3.0:1788568833.870066:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568833.870181:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958476160 00000100:00100000:2.0:1788568833.870190:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958476160 00000100:00100000:2.0:1788568833.870302:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 7 00000100:00100000:2.0:1788568833.870313:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273b65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+6:13761:x1875449958476160:12345-192.168.206.4@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788568833.870433:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273b65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+6:13761:x1875449958476160:12345-192.168.206.4@tcp:40:mount.lustre.0 Request processed in 121us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568833.870440:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 7 00000100:00100000:0.0:1788568833.879875:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568833.882212:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958476544 00000100:00100000:3.0:1788568833.882226:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958476544 00000100:00100000:3.0:1788568833.882285:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 0 00000100:00100000:3.0:1788568833.882295:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+6:13761:x1875449958476544:12345-192.168.206.4@tcp:33:mount.lustre.0 00000100:00100000:2.0:1788568833.882606:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568833.882655:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000004:00080000:0.0:1788568833.886124:0:14425:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3758us 00000100:00100000:1.0:1788568833.887236:0:15721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958476288 00000100:00100000:1.0:1788568833.887247:0:15721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958476288 00000100:00100000:1.0:1788568833.887291:0:15721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958476416 00000100:00100000:1.0:1788568833.887294:0:15721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958476416 00000100:00100000:1.0:1788568833.887324:0:15721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 8 00000100:00100000:1.0:1788568833.887333:0:15721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2360:x1875449958476288:12345-192.168.206.4@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788568833.887362:0:15721:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from bf0a011c-1a89-4994-b3cd-fb988f4b42d4@192.168.206.4@tcp t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:1.0:1788568833.887393:0:15721:0:(genops.c:1385:class_connect()) connect: client bf0a011c-1a89-4994-b3cd-fb988f4b42d4, cookie 0x41e82f464b6a210c 00002000:00100000:1.0:1788568833.887404:0:15721:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bf0a011c-1a89-4994-b3cd-fb988f4b42d4/ffff9ae24de28000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788568833.887425:0:15721:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788568833.887749:0:15721:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788568833.887779:0:15721:0:(import.c:65:import_set_state_nolock()) ffff9ae24de2b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788568833.887845:0:15721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+6:2360:x1875449958476288:12345-192.168.206.4@tcp:8:mount.lustre.0 Request processed in 512us (5240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568833.887853:0:15721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 8 00000100:00100000:1.0:1788568833.887869:0:15721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 9 00000100:00100000:1.0:1788568833.887874:0:15721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2360:x1875449958476416:12345-192.168.206.4@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788568833.887899:0:15721:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from bf0a011c-1a89-4994-b3cd-fb988f4b42d4@192.168.206.4@tcp t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:1.0:1788568833.888052:0:15721:0:(genops.c:1385:class_connect()) connect: client bf0a011c-1a89-4994-b3cd-fb988f4b42d4, cookie 0x41e82f464b6a2113 00002000:00100000:1.0:1788568833.888058:0:15721:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bf0a011c-1a89-4994-b3cd-fb988f4b42d4/ffff9ae24de2a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788568833.888071:0:15721:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788568833.888192:0:15721:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788568833.888207:0:15721:0:(import.c:65:import_set_state_nolock()) ffff9ae24de2d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788568833.888234:0:15721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+6:2360:x1875449958476416:12345-192.168.206.4@tcp:8:mount.lustre.0 Request processed in 358us (5578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568833.888241:0:15721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 9 00000004:00200000:1.0:1788568833.897612:0:14425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788568833.897749:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+6:13761:x1875449958476544:12345-192.168.206.4@tcp:33:mount.lustre.0 Request processed in 15451us (17877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568833.897762:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 0 00000100:00100000:0.0:1788568834.039247:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788568834.039268:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273b64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976296320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788568834.039332:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568834.039487:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976296320 00000100:00100000:3.0:1788568834.039495:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976296320 00000100:00100000:3.0:1788568834.039558:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788568834.039567:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b565180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976296320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788568834.039587:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788568834.039647:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b565180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976296320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568834.039654:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788568834.039747:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788568834.040111:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273b64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976296320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788568834.179759:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568834.179966:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958476672 00000100:00100000:0.0:1788568834.179979:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958476672 00000100:00100000:0.0:1788568834.180054:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 8 00000100:00100000:0.0:1788568834.180067:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+6:13805:x1875449958476672:12345-192.168.206.4@tcp:101:mkdir.0 00010000:00010000:0.0:1788568834.180091:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568834.180123:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147e00/0x41e82f464b6a211a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beeec expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568834.180206:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147000/0x41e82f464b6a2121 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568834.180223:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147000/0x41e82f464b6a2121 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568834.180241:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147000/0x41e82f464b6a2121 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788568834.180306:0:14423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788568834.180311:0:14423:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788568834.180366:0:14423:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147000/0x41e82f464b6a2121 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568834.180396:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147e00/0x41e82f464b6a211a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beeec expref: 8 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568834.180415:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147000/0x41e82f464b6a2121 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beeec expref: 7 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568834.180423:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae256682e00) 00010000:00010000:0.0:1788568834.180427:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788568834.180431:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae253147000, rc 0) 00000100:00100000:0.0:1788568834.180504:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+7:13805:x1875449958476672:12345-192.168.206.4@tcp:101:mkdir.0 Request processed in 439us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568834.180511:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 8 00010000:00010000:2.0:1788568834.296595:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568835.320793:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568836.090403:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788568836.090449:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b564a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976296448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788568836.090637:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568836.090802:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976296448 00000100:00100000:2.0:1788568836.090812:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976296448 00000100:00100000:2.0:1788568836.090991:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788568836.091009:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875449976296448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788568836.091053:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788568836.091110:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875449976296448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568836.091118:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788568836.091188:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b564a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976296448:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788568836.091294:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788568836.102316:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae251dc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976296704:0@lo:400:kworker.0 00000100:00100000:0.0:1788568836.102379:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568836.102424:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788568836.102431:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b564a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bbee97af-a6b0-4265-8c9f-26b826a76798:3307:1875449976296576:0@lo:400:kworker.0 00000100:00100000:0.0:1788568836.102460:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568836.102481:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae251dc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875449976297088:0@lo:400:kworker.0 00000100:00100000:0.0:1788568836.102504:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568836.102529:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae251dc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875449976296832:0@lo:400:kworker.0 00000100:00100000:0.0:1788568836.102566:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568836.102584:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788568836.102590:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae251dc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976296960:0@lo:400:kworker.0 00000100:00100000:0.0:1788568836.102753:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568836.102784:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976296576 00000100:00100000:0.0:1788568836.102791:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976296576 00000100:00100000:0.0:1788568836.102831:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788568836.102840:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273abb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+19:3307:x1875449976296576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568836.102887:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273abb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+19:3307:x1875449976296576:12345-0@lo:400:kworker.0 Request processed in 48us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568836.102894:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788568836.102958:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976297088 00000100:00100000:0.0:1788568836.102963:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976297088 00000100:00100000:0.0:1788568836.102992:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976296832 00000100:00100000:0.0:1788568836.102996:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976296832 00000100:00100000:0.0:1788568836.103007:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976296960 00000100:00100000:0.0:1788568836.103009:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976296960 00000100:00100000:0.0:1788568836.103023:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788568836.103029:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875449976297088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568836.103061:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875449976297088:12345-0@lo:400:kworker.0 Request processed in 31us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568836.103067:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788568836.103079:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788568836.103085:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875449976296832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568836.105939:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875449976296832:12345-0@lo:400:kworker.0 Request processed in 2831us (3349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568836.105952:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788568836.106168:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788568836.106180:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976296960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568836.106240:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875449976296960:12345-0@lo:400:kworker.0 Request processed in 64us (3487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568836.106247:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1788568836.106482:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788568836.106523:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae251dc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875449976296960:0@lo:400:kworker.0 00000100:00100000:0.0:1788568836.106537:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae251dc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875449976296832:0@lo:400:kworker.0 00000100:00100000:0.0:1788568836.106574:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b564a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bbee97af-a6b0-4265-8c9f-26b826a76798:3307:1875449976296576:0@lo:400:kworker.0 00000100:00100000:0.0:1788568836.106586:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae251dc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875449976297088:0@lo:400:kworker.0 00000100:00100000:0.0:1788568836.106627:0:15721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976296704 00000100:00100000:0.0:1788568836.106633:0:15721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976296704 00000100:00100000:1.0:1788568836.118721:0:15721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788568836.118741:0:15721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976296704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568836.118861:0:15721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976296704:12345-0@lo:400:kworker.0 Request processed in 126us (16480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568836.118915:0:15721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788568836.119130:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788568836.119181:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae251dc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976296704:0@lo:400:kworker.0 00000001:00100000:0.0:1788568836.287170:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bf0a011c-1a89-4994-b3cd-fb988f4b42d4 00000001:00080000:0.0:1788568836.287266:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1788568836.287306:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788568836.343868:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568836.421802:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568836.423482:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958476800 00000100:00100000:2.0:1788568836.423496:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958476800 00000100:00100000:2.0:1788568836.423594:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 9 00000100:00100000:2.0:1788568836.423606:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+7:13857:x1875449958476800:12345-192.168.206.4@tcp:41:lfs.0 00000004:00000024:2.0:1788568836.424119:0:14422:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:1.0:1788568836.424289:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788568836.424326:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+7:13857:x1875449958476800:12345-192.168.206.4@tcp:41:lfs.0 Request processed in 721us (2530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568836.424334:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 9 00000100:00100000:3.0:1788568836.435912:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568836.436445:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958476928 00000100:00100000:2.0:1788568836.436459:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958476928 00000100:00080000:1.0:1788568836.436582:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788568836.436672:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 5 00000100:00100000:2.0:1788568836.436686:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+6:13857:x1875449958476928:12345-192.168.206.4@tcp:13:lfs.0 00002000:00000024:2.0:1788568836.436798:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788568836.436905:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+6:13857:x1875449958476928:12345-192.168.206.4@tcp:13:lfs.0 Request processed in 221us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568836.436914:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 5 00000100:00100000:3.0:1788568836.445158:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568836.445282:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958477056 00000100:00100000:2.0:1788568836.445294:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958477056 00000100:00100000:2.0:1788568836.445388:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 6 00000100:00100000:2.0:1788568836.445401:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273b64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+5:13857:x1875449958477056:12345-192.168.206.4@tcp:13:lfs.0 00002000:00000024:2.0:1788568836.445433:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788568836.445548:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273b64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+5:13857:x1875449958477056:12345-192.168.206.4@tcp:13:lfs.0 Request processed in 150us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568836.445557:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 6 00000100:00080000:1.0:1788568836.445842:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788568836.692813:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568836.694307:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958477184 00000100:00100000:1.0:1788568836.694324:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958477184 00000100:00100000:1.0:1788568836.694415:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 91 00000100:00100000:1.0:1788568836.694428:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273ab9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54c998a2-cb2f-4cd7-8309-f29c84f83a13+10:13885:x1875449958477184:12345-192.168.206.4@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788568836.694447:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568836.694470:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae273b2da00/0x41e82f464b6a2128 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beef3 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568836.694506:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae273b2da00/0x41e82f464b6a2128 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beef3 expref: 11 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568836.694519:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae273b2da00/0x41e82f464b6a2128 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beef3 expref: 11 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568836.694529:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2da00, rc 0) 00000100:00100000:1.0:1788568836.694627:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273ab9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54c998a2-cb2f-4cd7-8309-f29c84f83a13+11:13885:x1875449958477184:12345-192.168.206.4@tcp:101:mount.lustre.0 Request processed in 202us (1828us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568836.694635:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 91 00000100:00100000:0.0:1788568836.698264:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568836.698880:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958477312 00000100:00100000:1.0:1788568836.698894:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958477312 00000100:00100000:1.0:1788568836.699005:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 92 00000100:00100000:1.0:1788568836.699019:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273abb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54c998a2-cb2f-4cd7-8309-f29c84f83a13+11:13885:x1875449958477312:12345-192.168.206.4@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788568836.702606:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273abb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54c998a2-cb2f-4cd7-8309-f29c84f83a13+11:13885:x1875449958477312:12345-192.168.206.4@tcp:501:mount.lustre.0 Request processed in 3574us (4339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568836.702634:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 92 00000100:00100000:2.0:1788568836.724480:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568836.724960:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958477440 00000100:00100000:0.0:1788568836.724973:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958477440 00000100:00100000:0.0:1788568836.725043:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 93 00000100:00100000:0.0:1788568836.725055:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273abbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54c998a2-cb2f-4cd7-8309-f29c84f83a13+11:13885:x1875449958477440:12345-192.168.206.4@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788568836.726423:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273abbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54c998a2-cb2f-4cd7-8309-f29c84f83a13+11:13885:x1875449958477440:12345-192.168.206.4@tcp:503:mount.lustre.0 Request processed in 1361us (1950us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568836.726438:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 93 00000100:00100000:0.0:1788568836.750233:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568836.750546:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958477568 00000100:00100000:1.0:1788568836.750567:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958477568 00000100:00100000:1.0:1788568836.750663:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 94 00000100:00100000:1.0:1788568836.750686:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273ab9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54c998a2-cb2f-4cd7-8309-f29c84f83a13+11:13893:x1875449958477568:12345-192.168.206.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788568836.751405:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273ab9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54c998a2-cb2f-4cd7-8309-f29c84f83a13+11:13893:x1875449958477568:12345-192.168.206.4@tcp:502:llog_process_th.0 Request processed in 729us (1184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568836.751417:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 94 00000100:00100000:1.0:1788568836.784424:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568836.785449:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958477696 00000100:00100000:3.0:1788568836.785464:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958477696 00000100:00100000:3.0:1788568836.785533:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 95 00000100:00100000:3.0:1788568836.785554:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273ab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54c998a2-cb2f-4cd7-8309-f29c84f83a13+11:13893:x1875449958477696:12345-192.168.206.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788568836.785916:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273ab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54c998a2-cb2f-4cd7-8309-f29c84f83a13+11:13893:x1875449958477696:12345-192.168.206.4@tcp:502:llog_process_th.0 Request processed in 363us (1504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568836.785965:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 95 00000100:00100000:2.0:1788568836.803878:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568836.804495:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958477824 00000100:00100000:0.0:1788568836.804509:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958477824 00000100:00100000:0.0:1788568836.804575:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 96 00000100:00100000:0.0:1788568836.804586:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273ab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54c998a2-cb2f-4cd7-8309-f29c84f83a13+11:13885:x1875449958477824:12345-192.168.206.4@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788568836.804605:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568836.804637:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae253146c00/0x41e82f464b6a212f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bef1d expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568836.804669:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae253146c00/0x41e82f464b6a212f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef1d expref: 12 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568836.804682:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae253146c00/0x41e82f464b6a212f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef1d expref: 12 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568836.804692:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae253146c00, rc 0) 00000100:00100000:0.0:1788568836.804763:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273ab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54c998a2-cb2f-4cd7-8309-f29c84f83a13+12:13885:x1875449958477824:12345-192.168.206.4@tcp:101:mount.lustre.0 Request processed in 178us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568836.804771:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 96 00000100:00100000:0.0:1788568836.824900:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568836.825205:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958477952 00000100:00100000:1.0:1788568836.825218:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958477952 00000100:00100000:1.0:1788568836.825282:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 97 00000100:00100000:1.0:1788568836.825293:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273abb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54c998a2-cb2f-4cd7-8309-f29c84f83a13+12:13885:x1875449958477952:12345-192.168.206.4@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788568836.825325:0:14415:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788568836.825364:0:14415:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788568836.825368:0:14415:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788568836.825372:0:14415:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788568836.825375:0:14415:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1788568836.853020:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273abb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54c998a2-cb2f-4cd7-8309-f29c84f83a13+12:13885:x1875449958477952:12345-192.168.206.4@tcp:256:mount.lustre.0 Request processed in 27713us (28118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568836.853038:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 97 00000100:00100000:2.0:1788568836.876842:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568836.877206:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958478080 00000100:00100000:3.0:1788568836.877236:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958478080 00000100:00100000:3.0:1788568836.877303:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 98 00000100:00100000:3.0:1788568836.877315:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54c998a2-cb2f-4cd7-8309-f29c84f83a13+12:13885:x1875449958478080:12345-192.168.206.4@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788568836.877344:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568836.877367:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae2429de400/0x41e82f464b6a2136 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bef24 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568836.877402:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae2429de400/0x41e82f464b6a2136 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef24 expref: 13 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568836.877416:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae2429de400/0x41e82f464b6a2136 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef24 expref: 13 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568836.877427:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429de400, rc 0) 00000100:00100000:3.0:1788568836.877496:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54c998a2-cb2f-4cd7-8309-f29c84f83a13+13:13885:x1875449958478080:12345-192.168.206.4@tcp:101:mount.lustre.0 Request processed in 183us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568836.877504:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 98 00000100:00100000:2.0:1788568836.885695:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568836.885890:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958478208 00000100:00100000:0.0:1788568836.885904:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958478208 00000100:00100000:0.0:1788568836.886010:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 99 00000100:00100000:0.0:1788568836.886022:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54c998a2-cb2f-4cd7-8309-f29c84f83a13+13:13885:x1875449958478208:12345-192.168.206.4@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788568836.889900:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54c998a2-cb2f-4cd7-8309-f29c84f83a13+13:13885:x1875449958478208:12345-192.168.206.4@tcp:501:mount.lustre.0 Request processed in 3864us (4203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568836.889963:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 99 00000100:00100000:1.0:1788568836.894058:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568836.894285:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958478336 00000100:00100000:2.0:1788568836.894297:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958478336 00000100:00100000:2.0:1788568836.894370:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 100 00000100:00100000:2.0:1788568836.894382:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273ab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54c998a2-cb2f-4cd7-8309-f29c84f83a13+13:13885:x1875449958478336:12345-192.168.206.4@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788568836.894779:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273ab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54c998a2-cb2f-4cd7-8309-f29c84f83a13+13:13885:x1875449958478336:12345-192.168.206.4@tcp:503:mount.lustre.0 Request processed in 398us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568836.894788:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 100 00000100:00100000:2.0:1788568836.901083:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568836.901781:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958478464 00000100:00100000:0.0:1788568836.901795:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958478464 00000100:00100000:0.0:1788568836.901874:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 101 00000100:00100000:0.0:1788568836.901887:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273abd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54c998a2-cb2f-4cd7-8309-f29c84f83a13+13:13900:x1875449958478464:12345-192.168.206.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788568836.902577:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273abd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54c998a2-cb2f-4cd7-8309-f29c84f83a13+13:13900:x1875449958478464:12345-192.168.206.4@tcp:502:llog_process_th.0 Request processed in 690us (1505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568836.902587:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 101 00000100:00100000:0.0:1788568836.912515:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568836.924833:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958478592 00000100:00100000:3.0:1788568836.924855:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958478592 00000100:00100000:3.0:1788568836.924963:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 102 00000100:00100000:3.0:1788568836.924975:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273abdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54c998a2-cb2f-4cd7-8309-f29c84f83a13+13:13900:x1875449958478592:12345-192.168.206.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788568836.927121:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273abdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54c998a2-cb2f-4cd7-8309-f29c84f83a13+13:13900:x1875449958478592:12345-192.168.206.4@tcp:502:llog_process_th.0 Request processed in 2127us (14599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568836.927143:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 102 00000100:00100000:1.0:1788568836.955254:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568836.955368:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958478720 00000100:00100000:0.0:1788568836.955381:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958478720 00000100:00100000:0.0:1788568836.955444:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 10 00000100:00100000:0.0:1788568836.955454:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2360:x1875449958478720:12345-192.168.206.4@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788568836.955490:0:14423:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from ca5e95b8-1a6c-4c41-8942-85f6bd97825b@192.168.206.4@tcp t0 exp 0000000000000000 cur 471 last 0 00000020:00000080:0.0:1788568836.955546:0:14423:0:(genops.c:1385:class_connect()) connect: client ca5e95b8-1a6c-4c41-8942-85f6bd97825b, cookie 0x41e82f464b6a213d 00000004:00100000:0.0:1788568836.955595:0:14423:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788568836.955765:0:14423:0:(import.c:65:import_set_state_nolock()) ffff9ae27c7a3000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788568836.955857:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+6:2360:x1875449958478720:12345-192.168.206.4@tcp:38:mount.lustre.0 Request processed in 402us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568836.955865:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 10 00000100:00100000:2.0:1788568836.963631:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568836.963684:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568836.963839:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958478976 00000100:00100000:1.0:1788568836.963853:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958478976 00000100:00100000:1.0:1788568836.963955:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958478848 00000100:00100000:1.0:1788568836.963958:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958478848 00000100:00100000:1.0:1788568836.963977:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 11 00000100:00100000:1.0:1788568836.963988:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+7:13885:x1875449958478976:12345-192.168.206.4@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788568836.964043:0:14423:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788568836.964123:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+7:13885:x1875449958478976:12345-192.168.206.4@tcp:41:mount.lustre.0 Request processed in 136us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568836.964131:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 11 00000100:00100000:1.0:1788568836.964168:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 12 00000100:00100000:1.0:1788568836.964174:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+6:0:x1875449958478848:12345-192.168.206.4@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788568836.964184:0:14423:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788568836.964206:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+6:0:x1875449958478848:12345-192.168.206.4@tcp:41:mount.lustre.0 Request processed in 33us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568836.964212:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 12 00000100:00080000:2.0:1788568836.964958:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788568836.974418:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568836.974833:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958479104 00000100:00100000:1.0:1788568836.974856:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958479104 00000100:00100000:1.0:1788568836.974959:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 13 00000100:00100000:1.0:1788568836.974972:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+6:13885:x1875449958479104:12345-192.168.206.4@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788568836.975082:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+6:13885:x1875449958479104:12345-192.168.206.4@tcp:40:mount.lustre.0 Request processed in 112us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568836.975091:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 13 00000100:00100000:1.0:1788568836.983658:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568836.983863:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568836.984011:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568836.984085:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958479488 00000100:00100000:2.0:1788568836.984097:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958479488 00000100:00100000:2.0:1788568836.984162:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 1 00000100:00100000:2.0:1788568836.984174:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+6:13885:x1875449958479488:12345-192.168.206.4@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788568836.984821:0:14424:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788568836.984951:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+6:13885:x1875449958479488:12345-192.168.206.4@tcp:33:mount.lustre.0 Request processed in 755us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568836.984959:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 1 00000100:00100000:0.0:1788568837.029352:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958479232 00000100:00100000:0.0:1788568837.029379:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958479232 00000100:00100000:0.0:1788568837.029450:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958479360 00000100:00100000:0.0:1788568837.029455:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958479360 00000100:00100000:0.0:1788568837.029486:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 10 00000100:00100000:0.0:1788568837.029497:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1875449958479232:12345-192.168.206.4@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788568837.029579:0:15106:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from ca5e95b8-1a6c-4c41-8942-85f6bd97825b@192.168.206.4@tcp t0 exp 0000000000000000 cur 471 last 0 00000020:00000080:0.0:1788568837.029632:0:15106:0:(genops.c:1385:class_connect()) connect: client ca5e95b8-1a6c-4c41-8942-85f6bd97825b, cookie 0x41e82f464b6a2144 00002000:00100000:0.0:1788568837.029646:0:15106:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ca5e95b8-1a6c-4c41-8942-85f6bd97825b/ffff9ae27c7a5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788568837.029659:0:15106:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1788568837.029882:0:15721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 11 00000100:00100000:2.0:1788568837.029889:0:15721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2360:x1875449958479360:12345-192.168.206.4@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788568837.029910:0:15721:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from ca5e95b8-1a6c-4c41-8942-85f6bd97825b@192.168.206.4@tcp t0 exp 0000000000000000 cur 471 last 0 00000020:00000080:2.0:1788568837.029950:0:15721:0:(genops.c:1385:class_connect()) connect: client ca5e95b8-1a6c-4c41-8942-85f6bd97825b, cookie 0x41e82f464b6a214b 00002000:00100000:2.0:1788568837.029964:0:15721:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ca5e95b8-1a6c-4c41-8942-85f6bd97825b/ffff9ae27913a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788568837.029972:0:15721:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788568837.030375:0:15721:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788568837.030426:0:15721:0:(import.c:65:import_set_state_nolock()) ffff9ae27913d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788568837.030519:0:15721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+6:2360:x1875449958479360:12345-192.168.206.4@tcp:8:mount.lustre.0 Request processed in 625us (46505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568837.030530:0:15721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 11 00002000:00080000:0.0:1788568837.032998:0:15106:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788568837.033053:0:15106:0:(import.c:65:import_set_state_nolock()) ffff9ae27c7a7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788568837.033581:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+6:2360:x1875449958479232:12345-192.168.206.4@tcp:8:mount.lustre.0 Request processed in 4081us (49941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568837.033594:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 10 00000001:00100000:2.0:1788568837.204029:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ca5e95b8-1a6c-4c41-8942-85f6bd97825b 00000001:00100000:2.0:1788568837.204045:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bf0a011c-1a89-4994-b3cd-fb988f4b42d4 00000100:00100000:1.0:1788568837.319645:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568837.319805:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958479616 00000100:00100000:0.0:1788568837.319815:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958479616 00000100:00100000:0.0:1788568837.319875:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 14 00000100:00100000:0.0:1788568837.319885:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+6:13921:x1875449958479616:12345-192.168.206.4@tcp:101:mkdir.0 00010000:00010000:0.0:1788568837.319903:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568837.319923:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146600/0x41e82f464b6a2152 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bef4e expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568837.320037:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146a00/0x41e82f464b6a2159 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568837.320060:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146a00/0x41e82f464b6a2159 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568837.320074:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146a00/0x41e82f464b6a2159 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788568837.320106:0:14422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788568837.320121:0:14422:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788568837.320144:0:14422:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146a00/0x41e82f464b6a2159 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568837.320166:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146600/0x41e82f464b6a2152 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef4e expref: 8 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568837.320182:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146a00/0x41e82f464b6a2159 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef4e expref: 7 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568837.320190:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae256682e00) 00010000:00010000:0.0:1788568837.320192:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788568837.320196:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae253146a00, rc 0) 00000100:00100000:0.0:1788568837.320245:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+7:13921:x1875449958479616:12345-192.168.206.4@tcp:101:mkdir.0 Request processed in 361us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568837.320252:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 14 00010000:00010000:1.0:1788568837.367145:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568838.393295:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568839.165111:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae251dc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976297216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788568839.165195:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568839.166438:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976297216 00000100:00100000:0.0:1788568839.166453:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976297216 00000100:00100000:0.0:1788568839.166531:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788568839.166544:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976297216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788568839.166587:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788568839.166670:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976297216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (1474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568839.166677:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788568839.166736:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae251dc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976297216:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788568839.167414:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1788568839.221716:0:5865:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ca5e95b8-1a6c-4c41-8942-85f6bd97825b 00000001:00100000:1.0:1788568839.221744:0:5865:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bf0a011c-1a89-4994-b3cd-fb988f4b42d4 00010000:00010000:1.0:1788568839.415148:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788568840.135753:0:16382:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788568840.449870:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788568840.827736:0:14454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788568841.208215:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273b65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976297472:0@lo:400:kworker.0 00000100:00100000:3.0:1788568841.208321:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568841.208382:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2526d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875449976297984:0@lo:400:kworker.0 00000100:00100000:3.0:1788568841.208413:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568841.208438:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788568841.208457:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273b67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bbee97af-a6b0-4265-8c9f-26b826a76798:3309:1875449976297344:0@lo:400:kworker.0 00000100:00100000:3.0:1788568841.208491:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568841.208515:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875449976297856:0@lo:400:kworker.0 00000100:00100000:3.0:1788568841.208550:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568841.208576:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976297600:0@lo:400:kworker.0 00000100:00100000:3.0:1788568841.208611:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568841.208629:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788568841.208634:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976297728:0@lo:400:kworker.0 00000100:00100000:3.0:1788568841.208653:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568841.208681:0:15721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976297472 00000100:00100000:3.0:1788568841.208688:0:15721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976297472 00000100:00100000:3.0:1788568841.208743:0:15721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976297600 00000100:00100000:3.0:1788568841.208746:0:15721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976297600 00000100:00100000:3.0:1788568841.208767:0:15721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788568841.208777:0:15721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976297472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568841.208829:0:15721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976297472:12345-0@lo:400:kworker.0 Request processed in 52us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568841.208836:0:15721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788568841.208852:0:15721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788568841.208858:0:15721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976297600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568841.208883:0:15721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976297600:12345-0@lo:400:kworker.0 Request processed in 26us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568841.208899:0:15721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788568841.208917:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976297984 00000100:00100000:3.0:1788568841.208920:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976297984 00000100:00100000:3.0:1788568841.208962:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976297856 00000100:00100000:3.0:1788568841.208964:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976297856 00000100:00100000:3.0:1788568841.208973:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976297728 00000100:00100000:3.0:1788568841.208976:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976297728 00000100:00100000:3.0:1788568841.208987:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788568841.208993:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875449976297984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568841.209276:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788568841.209294:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae251dc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976298112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788568841.209328:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568841.209375:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976297344 00000100:00100000:0.0:1788568841.209380:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976297344 00000100:00100000:0.0:1788568841.209410:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788568841.209417:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273abec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+19:3309:x1875449976297344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568841.209459:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273abec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+19:3309:x1875449976297344:12345-0@lo:400:kworker.0 Request processed in 43us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568841.209467:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788568841.209499:0:14422:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788568841.209507:0:14422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788568841.209543:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976298112 00000100:00100000:0.0:1788568841.209547:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976298112 00000100:00100000:0.0:1788568841.209571:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788568841.209577:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976298112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788568841.209620:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788568841.209658:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976298112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568841.209665:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788568841.209783:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788568841.209809:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae251dc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976298112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788568841.209843:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788568841.209850:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875449976297856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568841.209880:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875449976297856:12345-0@lo:400:kworker.0 Request processed in 31us (1330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568841.209887:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788568841.209906:0:14422:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788568841.209913:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788568841.209918:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976297728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568841.209966:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875449976297728:12345-0@lo:400:kworker.0 Request processed in 47us (1311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568841.209972:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788568841.210269:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875449976297984:12345-0@lo:400:kworker.0 Request processed in 1273us (1853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568841.210278:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788568841.210305:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788568841.210311:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788568841.210314:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788568841.210341:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875449976297728:0@lo:400:kworker.0 00000100:00100000:3.0:1788568841.210352:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976297600:0@lo:400:kworker.0 00000100:00100000:3.0:1788568841.210380:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273b67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bbee97af-a6b0-4265-8c9f-26b826a76798:3309:1875449976297344:0@lo:400:kworker.0 00000100:00100000:3.0:1788568841.210390:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875449976297856:0@lo:400:kworker.0 00000100:00100000:3.0:1788568841.210402:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273b65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976297472:0@lo:400:kworker.0 00000100:00100000:3.0:1788568841.210413:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2526d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875449976297984:0@lo:400:kworker.0 00000001:00100000:0.0:1788568841.319166:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ca5e95b8-1a6c-4c41-8942-85f6bd97825b 00010000:00010000:0.0:1788568841.464642:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568842.256825:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568842.256875:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568842.256903:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568842.256963:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568842.256985:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568842.257002:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568842.257060:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568842.257157:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958479872 00000100:00100000:0.0:1788568842.257171:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958479872 00000100:00100000:0.0:1788568842.257246:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958480256 00000100:00100000:0.0:1788568842.257249:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958480256 00000100:00100000:0.0:1788568842.257277:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 19 00000100:00100000:0.0:1788568842.257289:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+6:2361:x1875449958479872:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:0.0:1788568842.257385:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+6:2361:x1875449958479872:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 98us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568842.257394:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 19 00000100:00100000:0.0:1788568842.257413:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 20 00000100:00100000:0.0:1788568842.257421:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+6:2361:x1875449958480256:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:0.0:1788568842.257447:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+6:2361:x1875449958480256:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 27us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568842.257453:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 20 00000100:00100000:0.0:1788568842.257472:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958480128 00000100:00100000:0.0:1788568842.257476:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958480128 00000100:00100000:0.0:1788568842.257495:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958480384 00000100:00100000:0.0:1788568842.257498:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958480384 00000100:00100000:0.0:1788568842.257510:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958480000 00000100:00100000:0.0:1788568842.257525:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958480000 00000100:00100000:0.0:1788568842.257542:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958480512 00000100:00100000:0.0:1788568842.257545:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958480512 00000100:00100000:0.0:1788568842.257558:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 5 00000100:00100000:0.0:1788568842.257564:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+5:2361:x1875449958480128:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:0.0:1788568842.257603:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+5:2361:x1875449958480128:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 39us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568842.257610:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 5 00000100:00100000:0.0:1788568842.257622:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 6 00000100:00100000:0.0:1788568842.257628:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+5:2361:x1875449958480384:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:0.0:1788568842.257656:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+5:2361:x1875449958480384:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 28us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568842.257662:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 6 00000100:00100000:0.0:1788568842.257673:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 7 00000100:00100000:0.0:1788568842.257678:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+5:2361:x1875449958480000:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:0.0:1788568842.257700:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+5:2361:x1875449958480000:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 21us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568842.257706:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 7 00000100:00100000:0.0:1788568842.257717:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 8 00000100:00100000:0.0:1788568842.257723:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+5:2361:x1875449958480512:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:0.0:1788568842.257744:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+5:2361:x1875449958480512:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 22us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568842.257749:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 8 00000100:00080000:2.0:1788568842.257964:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788568842.257969:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788568842.257972:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788568842.258073:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958479744 00000100:00100000:3.0:1788568842.258078:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958479744 00000100:00100000:3.0:1788568842.258119:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 104 00000100:00100000:3.0:1788568842.258127:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273abc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54c998a2-cb2f-4cd7-8309-f29c84f83a13+13:2361:x1875449958479744:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:3.0:1788568842.258175:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273abc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54c998a2-cb2f-4cd7-8309-f29c84f83a13+13:2361:x1875449958479744:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 50us (1212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568842.258182:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 104 00010000:00010000:2.0:1788568842.489007:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568843.512863:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568844.281382:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae251dc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976298240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788568844.281479:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568844.281658:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976298240 00000100:00100000:0.0:1788568844.281668:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976298240 00000100:00100000:0.0:1788568844.281737:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788568844.281750:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976298240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788568844.281794:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788568844.281846:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976298240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568844.281855:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1788568844.281884:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788568844.281951:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae251dc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976298240:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1788568844.380732:0:16532:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe46df40a0 20000000:00000080:3.0:1788568844.380763:0:16532:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ae1432e8000 uarg=0000000000000000 20000000:01000000:3.0:1788568844.380813:0:16532:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788568844.380820:0:16532:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788568844.380827:0:16532:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788568844.393536:0:16533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1788568844.393809:0:16532:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788568844.404140:0:16532:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788568844.404209:0:16532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ae2429de800/0x41e82f464b6a2160 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568844.404232:0:16532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae273b2dc00/0x41e82f464b6a1e57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a1e50 expref: 18 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568844.404242:0:16532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae273b2c800/0x41e82f464b6a1ea4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a1e9d expref: 18 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568844.404249:0:16532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae2429dfa00/0x41e82f464b6a1fd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a1fd1 expref: 18 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568844.404260:0:16532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae2429dec00/0x41e82f464b6a20fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beec2 expref: 12 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568844.404268:0:16532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae2429de400/0x41e82f464b6a2136 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef24 expref: 12 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568844.404276:0:16532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ae2429de800/0x41e82f464b6a2160 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568844.404421:0:16532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae2429de400/0x41e82f464b6a2136 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef24 expref: 12 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568844.404438:0:16532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae2429de400/0x41e82f464b6a2136 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef24 expref: 12 pid: 14416 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568844.404456:0:16532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2526d5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16532:1875449976298368:192.168.206.4@tcp:104: 00010000:00010000:3.0:1788568844.404648:0:16532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae2429dec00/0x41e82f464b6a20fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beec2 expref: 12 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568844.404658:0:16532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae2429dec00/0x41e82f464b6a20fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beec2 expref: 12 pid: 14416 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568844.404667:0:16532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2526d4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16532:1875449976298496:192.168.206.4@tcp:104: 00010000:00010000:3.0:1788568844.404702:0:16532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae2429dfa00/0x41e82f464b6a1fd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x41e82f464b6a1fd1 expref: 18 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568844.404710:0:16532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae2429dfa00/0x41e82f464b6a1fd8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x41e82f464b6a1fd1 expref: 18 pid: 14415 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568844.404720:0:16532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2526d5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16532:1875449976298624:0@lo:104: 00000100:00100000:3.0:1788568844.404766:0:16532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788568844.404818:0:16532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae273b2c800/0x41e82f464b6a1ea4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x41e82f464b6a1e9d expref: 18 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568844.404827:0:16532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae273b2c800/0x41e82f464b6a1ea4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x41e82f464b6a1e9d expref: 18 pid: 14416 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568844.404848:0:16532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2526d4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16532:1875449976298752:0@lo:104: 00000100:00100000:3.0:1788568844.404870:0:16532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788568844.404902:0:16532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae273b2dc00/0x41e82f464b6a1e57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x41e82f464b6a1e50 expref: 18 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568844.404911:0:16532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae273b2dc00/0x41e82f464b6a1e57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x41e82f464b6a1e50 expref: 18 pid: 14414 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568844.404918:0:16532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2526d7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16532:1875449976298880:0@lo:104: 00000100:00100000:3.0:1788568844.404988:0:16532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568844.405828:0:14405:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788568844.405856:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976298624 00000100:00100000:1.0:1788568844.405865:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976298624 00000100:00100000:1.0:1788568844.405913:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976298752 00000100:00100000:1.0:1788568844.405917:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976298752 00000100:00100000:1.0:1788568844.405944:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976298880 00000100:00100000:1.0:1788568844.405948:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976298880 00000100:00100000:1.0:1788568844.405962:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788568844.405972:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bbee97af-a6b0-4265-8c9f-26b826a76798+5:16532:x1875449976298624:12345-0@lo:104: 00010000:00010000:1.0:1788568844.405989:0:14405:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.104@tcp lock: ffff9ae252e7ae00/0x41e82f464b6a1fd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a1fd8 expref: -99 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568844.406073:0:14405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788568844.406081:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bbee97af-a6b0-4265-8c9f-26b826a76798+5:16532:x1875449976298624:12345-0@lo:104: Request processed in 110us (1315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568844.406089:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788568844.406108:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788568844.406125:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bbee97af-a6b0-4265-8c9f-26b826a76798+4:16532:x1875449976298752:12345-0@lo:104: 00010000:00010000:1.0:1788568844.406134:0:14405:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b200/0x41e82f464b6a1e9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a1ea4 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568844.406166:0:14405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788568844.406172:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bbee97af-a6b0-4265-8c9f-26b826a76798+4:16532:x1875449976298752:12345-0@lo:104: Request processed in 49us (1301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568844.406178:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788568844.406189:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788568844.406195:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26f6f1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bbee97af-a6b0-4265-8c9f-26b826a76798+3:16532:x1875449976298880:12345-0@lo:104: 00010000:00010000:1.0:1788568844.406203:0:14405:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d000/0x41e82f464b6a1e50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a1e57 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568844.406243:0:14405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788568844.406248:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26f6f1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bbee97af-a6b0-4265-8c9f-26b826a76798+3:16532:x1875449976298880:12345-0@lo:104: Request processed in 54us (1260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568844.406254:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788568844.406828:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788568844.406838:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae252e7ae00/0x41e82f464b6a1fd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a1fd8 expref: -99 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568844.406845:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7ae00 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:0.0:1788568844.406849:0:14409:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae252e7ae00/0x41e82f464b6a1fd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x41e82f464b6a1fd8 expref: -99 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568844.406859:0:14409:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae252e7ae00/0x41e82f464b6a1fd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x41e82f464b6a1fd8 expref: -99 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788568844.406866:0:14409:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae252e7ae00/0x41e82f464b6a1fd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x41e82f464b6a1fd8 expref: -99 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568844.406872:0:14409:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788568844.406919:0:14409:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae252e7ae00/0x41e82f464b6a1fd1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a1fd8 expref: -99 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568844.406972:0:14409:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788568844.407015:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae252e7ae00/0x41e82f464b6a1fd1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a1fd8 expref: -99 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568844.407023:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae252e7ae00/0x41e82f464b6a1fd1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a1fd8 expref: -99 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568844.407048:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788568844.407051:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b200/0x41e82f464b6a1e9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a1ea4 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568844.407058:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae252e7b200 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:0.0:1788568844.407060:0:14409:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b200/0x41e82f464b6a1e9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x41e82f464b6a1ea4 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568844.407068:0:14409:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b200/0x41e82f464b6a1e9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x41e82f464b6a1ea4 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788568844.407075:0:14409:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b200/0x41e82f464b6a1e9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x41e82f464b6a1ea4 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568844.407080:0:14409:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1788568844.407096:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae251dc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bbee97af-a6b0-4265-8c9f-26b826a76798:3308:1875449976299008:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788568844.407104:0:14409:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b200/0x41e82f464b6a1e9d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a1ea4 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568844.407122:0:14409:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788568844.407130:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b200/0x41e82f464b6a1e9d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a1ea4 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568844.407137:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae252e7b200/0x41e82f464b6a1e9d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a1ea4 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568844.407152:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788568844.407159:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788568844.407164:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d000/0x41e82f464b6a1e50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x41e82f464b6a1e57 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568844.407171:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2d000 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:0.0:1788568844.407175:0:14409:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d000/0x41e82f464b6a1e50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x41e82f464b6a1e57 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568844.407183:0:14409:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d000/0x41e82f464b6a1e50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x41e82f464b6a1e57 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788568844.407190:0:14409:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d000/0x41e82f464b6a1e50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x41e82f464b6a1e57 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568844.407196:0:14409:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1788568844.407198:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788568844.407207:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae251dc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bbee97af-a6b0-4265-8c9f-26b826a76798:3308:1875449976299136:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788568844.407215:0:14409:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d000/0x41e82f464b6a1e50 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a1e57 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568844.407223:0:14409:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788568844.407233:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788568844.407242:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d000/0x41e82f464b6a1e50 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a1e57 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568844.407251:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d000/0x41e82f464b6a1e50 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x41e82f464b6a1e57 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568844.407267:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568844.407269:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568844.407271:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568844.407279:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568844.407297:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976299008 00000100:00100000:0.0:1788568844.407303:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976299008 00010000:00010000:0.0:1788568844.407330:0:14408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae2429dfa00/0x41e82f464b6a1fd8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a1fd1 expref: 19 pid: 14415 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568844.407357:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976299136 00000100:00100000:0.0:1788568844.407360:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976299136 00010000:00010000:0.0:1788568844.407373:0:14408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae273b2c800/0x41e82f464b6a1ea4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a1e9d expref: 20 pid: 14416 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568844.407387:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788568844.407393:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbee97af-a6b0-4265-8c9f-26b826a76798+20:3308:x1875449976299008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788568844.407405:0:14408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568844.407411:0:14408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae2429dfa00/0x41e82f464b6a1fd8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a1fd1 expref: 20 pid: 14415 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568844.407422:0:14408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae2429dfa00/0x41e82f464b6a1fd8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x41e82f464b6a1fd1 expref: 20 pid: 14415 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568844.407451:0:14408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788568844.407486:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbee97af-a6b0-4265-8c9f-26b826a76798+20:3308:x1875449976299008:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568844.407493:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788568844.407508:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788568844.407514:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbee97af-a6b0-4265-8c9f-26b826a76798+19:3308:x1875449976299136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788568844.407521:0:14408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568844.407526:0:14408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae273b2c800/0x41e82f464b6a1ea4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a1e9d expref: 19 pid: 14416 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568844.407534:0:14408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae273b2c800/0x41e82f464b6a1ea4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x41e82f464b6a1e9d expref: 19 pid: 14416 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568844.407551:0:14408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788568844.407583:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbee97af-a6b0-4265-8c9f-26b826a76798+19:3308:x1875449976299136:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568844.407590:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788568844.407610:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae251dc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bbee97af-a6b0-4265-8c9f-26b826a76798:3306:1875449976299264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788568844.407638:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568844.407693:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976299264 00000100:00100000:0.0:1788568844.407697:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976299264 00010000:00010000:0.0:1788568844.407721:0:14407:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae273b2dc00/0x41e82f464b6a1e57 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a1e50 expref: 19 pid: 14414 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568844.407736:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788568844.407741:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277923050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbee97af-a6b0-4265-8c9f-26b826a76798+19:3306:x1875449976299264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788568844.407748:0:14407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568844.407752:0:14407:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae273b2dc00/0x41e82f464b6a1e57 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x41e82f464b6a1e50 expref: 19 pid: 14414 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568844.407760:0:14407:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae273b2dc00/0x41e82f464b6a1e57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x41e82f464b6a1e50 expref: 19 pid: 14414 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568844.407769:0:14407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788568844.407794:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277923050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbee97af-a6b0-4265-8c9f-26b826a76798+19:3306:x1875449976299264:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568844.407800:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788568844.407861:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae251dc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bbee97af-a6b0-4265-8c9f-26b826a76798:3306:1875449976299264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788568844.407886:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae251dc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bbee97af-a6b0-4265-8c9f-26b826a76798:3308:1875449976299136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788568844.407903:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae251dc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bbee97af-a6b0-4265-8c9f-26b826a76798:3308:1875449976299008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788568844.408166:0:16532:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2487d3900 going to sleep for 11 seconds 00010000:00010000:0.0:1788568844.408403:0:16532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae2429dfa00/0x41e82f464b6a1fd8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x41e82f464b6a1fd1 expref: 18 pid: 14415 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568844.408416:0:16532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2526d5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16532:1875449976298624:0@lo:104: 00010000:00010000:0.0:1788568844.408440:0:16532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae273b2c800/0x41e82f464b6a1ea4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x41e82f464b6a1e9d expref: 17 pid: 14416 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568844.408449:0:16532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2526d4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16532:1875449976298752:0@lo:104: 00010000:00010000:0.0:1788568844.408458:0:16532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae273b2dc00/0x41e82f464b6a1e57 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x41e82f464b6a1e50 expref: 16 pid: 14414 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568844.408467:0:16532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2526d7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16532:1875449976298880:0@lo:104: 00000100:00100000:0.0:1788568844.423178:0:16532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2526d5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16532:1875449976298368:192.168.206.4@tcp:104: 00000100:00100000:0.0:1788568844.423197:0:16532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2526d4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16532:1875449976298496:192.168.206.4@tcp:104: 00010000:00010000:0.0:1788568844.423243:0:16532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ae2429de800/0x41e82f464b6a2160 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568844.430153:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568844.430671:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958480640 00000100:00100000:0.0:1788568844.430684:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958480640 00010000:00010000:0.0:1788568844.431157:0:14407:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae2429de400/0x41e82f464b6a2136 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef24 expref: 13 pid: 14416 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568844.431211:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 7 00000100:00100000:0.0:1788568844.431222:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54c998a2-cb2f-4cd7-8309-f29c84f83a13+13:2363:x1875449958480640:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788568844.431241:0:14407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568844.431263:0:14407:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae2429de400/0x41e82f464b6a2136 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef24 expref: 13 pid: 14416 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568844.431279:0:14407:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae2429de400/0x41e82f464b6a2136 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef24 expref: 13 pid: 14416 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568844.431312:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae2429de400/0x41e82f464b6a2136 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef24 expref: 13 pid: 14416 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568844.431333:0:14407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788568844.431393:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54c998a2-cb2f-4cd7-8309-f29c84f83a13+12:2363:x1875449958480640:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 172us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568844.431401:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 7 00000100:00100000:2.0:1788568844.438351:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568844.438454:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958480768 00000100:00100000:0.0:1788568844.438468:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958480768 00010000:00010000:0.0:1788568844.438516:0:14406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae2429dec00/0x41e82f464b6a20fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beec2 expref: 12 pid: 14416 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568844.438564:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 8 00000100:00100000:0.0:1788568844.438586:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54c998a2-cb2f-4cd7-8309-f29c84f83a13+12:2364:x1875449958480768:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788568844.438605:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568844.438611:0:14406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae2429dec00/0x41e82f464b6a20fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beec2 expref: 12 pid: 14416 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568844.438627:0:14406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae2429dec00/0x41e82f464b6a20fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beec2 expref: 12 pid: 14416 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568844.438648:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae2429dec00/0x41e82f464b6a20fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beec2 expref: 12 pid: 14416 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568844.438692:0:14406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ae2429de800/0x41e82f464b6a2160 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568844.438702:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae2429de800/0x41e82f464b6a2160 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568844.438722:0:14406:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae2429de800/0x41e82f464b6a2160 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568844.438730:0:14406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae2429de800/0x41e82f464b6a2160 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568844.438738:0:14406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ae2429de800/0x41e82f464b6a2160 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568844.438745:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ae2429de800/0x41e82f464b6a2160 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568844.438752:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429de800 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788568844.438757:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ae2429de800/0x41e82f464b6a2160 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568844.438766:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ae2429de800/0x41e82f464b6a2160 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568844.438791:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ae2429de800/0x41e82f464b6a2160 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568844.438803:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788568844.438866:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54c998a2-cb2f-4cd7-8309-f29c84f83a13+11:2364:x1875449958480768:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 282us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568844.438880:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 8 00010000:00010000:1.0:1788568844.438968:0:16532:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ae2429de800/0x41e82f464b6a2160 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568844.438978:0:16532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ae2429de800/0x41e82f464b6a2160 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568844.438984:0:16532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae2429de800/0x41e82f464b6a2160 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568844.537468:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568845.559086:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568845.592921:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568845.593032:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958480896 00000100:00100000:0.0:1788568845.593041:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958480896 00000100:00100000:0.0:1788568845.593091:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 105 00000100:00100000:0.0:1788568845.593101:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273abe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54c998a2-cb2f-4cd7-8309-f29c84f83a13+11:13775:x1875449958480896:12345-192.168.206.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788568845.593116:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568845.593135:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae253147800/0x41e82f464b6a2167 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bef55 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568845.593161:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae253147800/0x41e82f464b6a2167 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef55 expref: 12 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568845.593172:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae253147800/0x41e82f464b6a2167 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef55 expref: 12 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568845.593181:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae253147800, rc 0) 00000100:00100000:0.0:1788568845.593254:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273abe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54c998a2-cb2f-4cd7-8309-f29c84f83a13+12:13775:x1875449958480896:12345-192.168.206.4@tcp:101:ll_cfg_requeue.0 Request processed in 153us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568845.593261:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 105 00000100:00100000:3.0:1788568845.603126:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568845.603217:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958481024 00000100:00100000:0.0:1788568845.603226:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958481024 00000100:00100000:0.0:1788568845.603281:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 106 00000100:00100000:0.0:1788568845.603300:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273abc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54c998a2-cb2f-4cd7-8309-f29c84f83a13+12:13775:x1875449958481024:12345-192.168.206.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788568845.603604:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273abc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54c998a2-cb2f-4cd7-8309-f29c84f83a13+12:13775:x1875449958481024:12345-192.168.206.4@tcp:501:ll_cfg_requeue.0 Request processed in 313us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568845.603622:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 106 00000100:00100000:1.0:1788568845.615383:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568845.615456:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958481152 00000100:00100000:0.0:1788568845.615467:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958481152 00000100:00100000:0.0:1788568845.615528:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 107 00000100:00100000:0.0:1788568845.615538:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273abf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54c998a2-cb2f-4cd7-8309-f29c84f83a13+12:13775:x1875449958481152:12345-192.168.206.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788568845.615765:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273abf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54c998a2-cb2f-4cd7-8309-f29c84f83a13+12:13775:x1875449958481152:12345-192.168.206.4@tcp:503:ll_cfg_requeue.0 Request processed in 228us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568845.615772:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 107 00000100:00100000:1.0:1788568845.643988:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568845.644034:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958481280 00000100:00100000:0.0:1788568845.644045:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958481280 00000100:00100000:0.0:1788568845.644099:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 108 00000100:00100000:0.0:1788568845.644110:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273abd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54c998a2-cb2f-4cd7-8309-f29c84f83a13+12:13775:x1875449958481280:12345-192.168.206.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788568845.644125:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568845.644143:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae253147400/0x41e82f464b6a216e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bef5c expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568845.644169:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae253147400/0x41e82f464b6a216e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef5c expref: 13 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568845.644180:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae253147400/0x41e82f464b6a216e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef5c expref: 13 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568845.644189:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae253147400, rc 0) 00000100:00100000:0.0:1788568845.644247:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273abd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54c998a2-cb2f-4cd7-8309-f29c84f83a13+13:13775:x1875449958481280:12345-192.168.206.4@tcp:101:ll_cfg_requeue.0 Request processed in 139us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568845.644253:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 108 00000100:00100000:0.0:1788568845.651055:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568845.652209:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958481408 00000100:00100000:3.0:1788568845.652221:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958481408 00000100:00100000:3.0:1788568845.652271:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 109 00000100:00100000:3.0:1788568845.652281:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273abf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54c998a2-cb2f-4cd7-8309-f29c84f83a13+13:13775:x1875449958481408:12345-192.168.206.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788568845.653413:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273abf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54c998a2-cb2f-4cd7-8309-f29c84f83a13+13:13775:x1875449958481408:12345-192.168.206.4@tcp:501:ll_cfg_requeue.0 Request processed in 1127us (2675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568845.653425:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 109 00000100:00100000:2.0:1788568845.673668:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568845.673830:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958481536 00000100:00100000:3.0:1788568845.673839:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958481536 00000100:00100000:3.0:1788568845.673906:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 110 00000100:00100000:3.0:1788568845.673916:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273abfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54c998a2-cb2f-4cd7-8309-f29c84f83a13+13:13775:x1875449958481536:12345-192.168.206.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788568845.674125:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273abfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54c998a2-cb2f-4cd7-8309-f29c84f83a13+13:13775:x1875449958481536:12345-192.168.206.4@tcp:503:ll_cfg_requeue.0 Request processed in 210us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568845.674142:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 110 10000000:01000000:0.0:1788568846.007015:0:14418:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788568846.007023:0:14418:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae24de2e800 from 10 10000000:01000000:0.0:1788568846.007028:0:14418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788568846.007073:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae253146200/0x41e82f464b6a2175 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568846.007084:0:14418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae253146200/0x41e82f464b6a2175 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568846.007094:0:14418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae253146200/0x41e82f464b6a2175 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568846.007130:0:14418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae251dc4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbee97af-a6b0-4265-8c9f-26b826a76798:14418:1875449976299392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788568846.007198:0:14418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568846.007250:0:14418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae27bcfb600 going to sleep for 11 seconds 00000100:00100000:3.0:1788568846.007422:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976299392 00000100:00100000:3.0:1788568846.007430:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976299392 00000100:00100000:3.0:1788568846.007479:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788568846.007488:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273abd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+16:14418:x1875449976299392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788568846.007499:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568846.007511:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae2429df000/0x41e82f464b6a217c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a2175 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568846.007531:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae2429df000/0x41e82f464b6a217c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a2175 expref: 17 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568846.007541:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae2429df000/0x41e82f464b6a217c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a2175 expref: 17 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568846.007549:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429df000, rc 0) 00000100:00100000:3.0:1788568846.007607:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273abd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+17:14418:x1875449976299392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568846.007614:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788568846.007697:0:14418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae251dc4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbee97af-a6b0-4265-8c9f-26b826a76798:14418:1875449976299392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788568846.007711:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae253146200/0x41e82f464b6a2175 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a217c expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568846.007720:0:14418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae253146200/0x41e82f464b6a2175 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a217c expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568846.007782:0:14418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbee97af-a6b0-4265-8c9f-26b826a76798:14418:1875449976299520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788568846.007808:0:14418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568846.007831:0:14418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2530769c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788568846.007963:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976299520 00000100:00100000:3.0:1788568846.007968:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976299520 00000100:00100000:3.0:1788568846.008114:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788568846.008122:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273abc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+17:14418:x1875449976299520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788568846.008336:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273abc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+17:14418:x1875449976299520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 214us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568846.008342:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788568846.008372:0:14418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbee97af-a6b0-4265-8c9f-26b826a76798:14418:1875449976299520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788568846.008407:0:14418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2526d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbee97af-a6b0-4265-8c9f-26b826a76798:14418:1875449976299648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788568846.008442:0:14418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568846.008457:0:14418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2487d3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788568846.008468:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976299648 00000100:00100000:3.0:1788568846.008472:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976299648 00000100:00100000:3.0:1788568846.008487:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788568846.008492:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273abcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+17:14418:x1875449976299648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788568846.008634:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273abcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+17:14418:x1875449976299648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568846.008641:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788568846.008679:0:14418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2526d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbee97af-a6b0-4265-8c9f-26b826a76798:14418:1875449976299648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788568846.011689:0:16586:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788568846.012001:0:14418:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788568846.012034:0:14418:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788568846.012044:0:14418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae253146200/0x41e82f464b6a2175 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a217c expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568846.012054:0:14418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae253146200/0x41e82f464b6a2175 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a217c expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788568846.012064:0:14418:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788568846.012066:0:14418:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae281739800 from 10 10000000:01000000:1.0:1788568846.012069:0:14418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788568846.012100:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d800/0x41e82f464b6a2183 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568846.012119:0:14418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d800/0x41e82f464b6a2183 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568846.012129:0:14418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d800/0x41e82f464b6a2183 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568846.012152:0:14418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbee97af-a6b0-4265-8c9f-26b826a76798:14418:1875449976299776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788568846.012212:0:14418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568846.012248:0:14418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2530769c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788568846.013078:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976299776 00000100:00100000:3.0:1788568846.013087:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976299776 00000100:00100000:3.0:1788568846.013145:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788568846.013154:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273abf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+17:14418:x1875449976299776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788568846.013167:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568846.013180:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae2429dfe00/0x41e82f464b6a218a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a2183 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568846.013202:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae2429dfe00/0x41e82f464b6a218a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a2183 expref: 18 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568846.013212:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae2429dfe00/0x41e82f464b6a218a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a2183 expref: 18 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568846.013220:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429dfe00, rc 0) 00000100:00100000:3.0:1788568846.013266:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273abf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+18:14418:x1875449976299776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568846.013271:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788568846.013494:0:14418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbee97af-a6b0-4265-8c9f-26b826a76798:14418:1875449976299776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788568846.013509:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d800/0x41e82f464b6a2183 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a218a expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568846.013518:0:14418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d800/0x41e82f464b6a2183 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a218a expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568846.013580:0:14418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbee97af-a6b0-4265-8c9f-26b826a76798:14418:1875449976299904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788568846.013611:0:14418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568846.013643:0:14418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2530769c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788568846.014099:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976299904 00000100:00100000:3.0:1788568846.014200:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976299904 00000100:00100000:3.0:1788568846.014245:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788568846.014253:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273abe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+18:14418:x1875449976299904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788568846.014479:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273abe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+18:14418:x1875449976299904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 224us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568846.014487:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788568846.014582:0:14418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbee97af-a6b0-4265-8c9f-26b826a76798:14418:1875449976299904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788568846.014617:0:14418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbee97af-a6b0-4265-8c9f-26b826a76798:14418:1875449976300032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788568846.014654:0:14418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568846.014683:0:14418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2530769c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788568846.014727:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976300032 00000100:00100000:3.0:1788568846.014731:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976300032 00000100:00100000:3.0:1788568846.015240:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788568846.015249:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273abe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+18:14418:x1875449976300032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788568846.015384:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273abe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+18:14418:x1875449976300032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568846.015390:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788568846.019143:0:14418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbee97af-a6b0-4265-8c9f-26b826a76798:14418:1875449976300032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788568846.019780:0:16588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788568846.019832:0:14418:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788568846.019847:0:14418:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788568846.019857:0:14418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d800/0x41e82f464b6a2183 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a218a expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568846.019867:0:14418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae273b2d800/0x41e82f464b6a2183 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a218a expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788568846.019877:0:14418:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788568846.019880:0:14418:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae26f783800 from 10 10000000:01000000:2.0:1788568846.021477:0:14418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788568846.021517:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae142d6a600/0x41e82f464b6a2191 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568846.021527:0:14418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.104@tcp lock: ffff9ae142d6a600/0x41e82f464b6a2191 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568846.021537:0:14418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.104@tcp lock: ffff9ae142d6a600/0x41e82f464b6a2191 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568846.021570:0:14418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbee97af-a6b0-4265-8c9f-26b826a76798:14418:1875449976300160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788568846.021630:0:14418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568846.021722:0:14418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24481f780 going to sleep for 11 seconds 00000100:00100000:3.0:1788568846.023123:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976300160 00000100:00100000:3.0:1788568846.023134:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976300160 00000100:00100000:3.0:1788568846.025065:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788568846.025083:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fb88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+18:14418:x1875449976300160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788568846.025099:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568846.025116:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a2198 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x41e82f464b6a2191 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568846.025141:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a2198 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x41e82f464b6a2191 expref: 19 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568846.025165:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae2429dee00/0x41e82f464b6a2198 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x41e82f464b6a2191 expref: 19 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568846.025174:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429dee00, rc 0) 00000100:00100000:3.0:1788568846.025262:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fb88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+19:14418:x1875449976300160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (3631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568846.025269:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788568846.027119:0:14418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbee97af-a6b0-4265-8c9f-26b826a76798:14418:1875449976300160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788568846.027145:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.104@tcp lock: ffff9ae142d6a600/0x41e82f464b6a2191 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a2198 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568846.027156:0:14418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.104@tcp lock: ffff9ae142d6a600/0x41e82f464b6a2191 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x41e82f464b6a2198 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568846.027225:0:14418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2526d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbee97af-a6b0-4265-8c9f-26b826a76798:14418:1875449976300288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788568846.027274:0:14418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568846.027307:0:14418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2487d3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788568846.027323:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976300288 00000100:00100000:3.0:1788568846.027328:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976300288 00000100:00100000:3.0:1788568846.027363:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788568846.027372:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fb8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+19:14418:x1875449976300288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788568846.027606:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fb8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+19:14418:x1875449976300288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 235us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568846.027614:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788568846.027647:0:14418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2526d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbee97af-a6b0-4265-8c9f-26b826a76798:14418:1875449976300288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788568846.027686:0:14418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2526d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbee97af-a6b0-4265-8c9f-26b826a76798:14418:1875449976300416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788568846.027722:0:14418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568846.027735:0:14418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2487d3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788568846.027745:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976300416 00000100:00100000:3.0:1788568846.027749:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976300416 00000100:00100000:3.0:1788568846.027763:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788568846.027768:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fb89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+19:14418:x1875449976300416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788568846.029690:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fb89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbee97af-a6b0-4265-8c9f-26b826a76798+19:14418:x1875449976300416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1914us (1960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568846.029703:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788568846.029783:0:14418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2526d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbee97af-a6b0-4265-8c9f-26b826a76798:14418:1875449976300416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788568846.032590:0:16589:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788568846.032690:0:14418:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788568846.032708:0:14418:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788568846.032719:0:14418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.104@tcp lock: ffff9ae142d6a600/0x41e82f464b6a2191 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a2198 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568846.032729:0:14418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.104@tcp lock: ffff9ae142d6a600/0x41e82f464b6a2191 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x41e82f464b6a2198 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568846.327251:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788568846.327273:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae251dc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976300544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788568846.327350:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568846.327631:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae251dc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875449976300928:0@lo:400:kworker.0 00000100:00100000:0.0:1788568846.327661:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568846.327682:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788568846.327688:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae251dc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875449976301056:0@lo:400:kworker.0 00000100:00100000:2.0:1788568846.327696:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976300544 00000100:00100000:2.0:1788568846.327704:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976300544 00000100:00100000:0.0:1788568846.327709:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568846.327731:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976300928 00000100:00100000:0.0:1788568846.327735:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976300928 00000100:00100000:2.0:1788568846.327753:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788568846.327759:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976301056 00000100:00100000:2.0:1788568846.327761:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976300544:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788568846.327761:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976301056 00000100:00100000:0.0:1788568846.327778:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788568846.327783:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875449976300928:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1788568846.327806:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788568846.327821:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875449976300928:12345-0@lo:400:kworker.0 Request processed in 37us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568846.327833:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788568846.327836:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875449976300544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568846.327842:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788568846.327848:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788568846.327853:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875449976301056:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788568846.327856:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788568846.327860:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788568846.327880:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875449976301056:12345-0@lo:400:kworker.0 Request processed in 26us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568846.327885:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788568846.327942:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae251dc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875449976301056:0@lo:400:kworker.0 00000100:00100000:0.0:1788568846.327954:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae251dc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875449976300928:0@lo:400:kworker.0 00000100:00100000:0.0:1788568846.327967:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae251dc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875449976300544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788568846.329167:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae251dc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875449976300800:0@lo:400:kworker.0 00000100:00100000:1.0:1788568846.329214:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568846.329252:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788568846.329258:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae251dc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976300672:0@lo:400:kworker.0 00000100:00100000:1.0:1788568846.329280:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568846.329422:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976300800 00000100:00100000:2.0:1788568846.329429:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976300800 00000100:00100000:2.0:1788568846.329476:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788568846.329484:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875449976300800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568846.329524:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875449976300800:12345-0@lo:400:kworker.0 Request processed in 42us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568846.329530:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788568846.329710:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae251dc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875449976300800:0@lo:400:kworker.0 00000100:00100000:2.0:1788568846.329795:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976300672 00000100:00100000:2.0:1788568846.329799:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976300672 00000100:00100000:2.0:1788568846.329843:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788568846.329850:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976300672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568846.329884:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976300672:12345-0@lo:400:kworker.0 Request processed in 35us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568846.329890:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788568846.330181:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788568846.330205:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae251dc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976300672:0@lo:400:kworker.0 00010000:00010000:0.0:1788568846.590075:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568847.386903:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568847.386968:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568847.387003:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568847.387077:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958482176 00000100:00100000:1.0:1788568847.387099:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958482176 00000100:00100000:1.0:1788568847.387160:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 24 00000100:00100000:1.0:1788568847.387173:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+6:2361:x1875449958482176:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:2.0:1788568847.387187:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568847.387235:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568847.387286:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+6:2361:x1875449958482176:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 113us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568847.387295:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 24 00000100:00100000:3.0:1788568847.387326:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958481664 00000100:00100000:1.0:1788568847.387334:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958481792 00000100:00100000:3.0:1788568847.387338:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958481664 00000100:00100000:1.0:1788568847.387342:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958481792 00000100:00100000:1.0:1788568847.387389:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 25 00000100:00100000:1.0:1788568847.387398:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+6:2361:x1875449958481792:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:3.0:1788568847.387405:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 120 00000100:00100000:3.0:1788568847.387419:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fb8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54c998a2-cb2f-4cd7-8309-f29c84f83a13+13:2361:x1875449958481664:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:1.0:1788568847.393780:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+6:2361:x1875449958481792:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 6372us (6532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568847.393795:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 25 00000100:00080000:1.0:1788568847.393843:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788568847.393909:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958481920 00000100:00100000:1.0:1788568847.393917:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958481920 00000100:00100000:1.0:1788568847.393982:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958482432 00000100:00100000:1.0:1788568847.393986:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958482432 00000100:00100000:1.0:1788568847.394008:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 10 00000100:00100000:1.0:1788568847.394017:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+5:2361:x1875449958481920:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:1.0:1788568847.394064:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+5:2361:x1875449958481920:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 49us (7099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568847.394071:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 10 00000100:00100000:1.0:1788568847.394082:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 11 00000100:00100000:1.0:1788568847.394103:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+5:2361:x1875449958482432:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:1.0:1788568847.394128:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+5:2361:x1875449958482432:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 40us (6954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568847.394135:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 11 00000100:00080000:1.0:1788568847.394150:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788568847.394153:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788568847.396758:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568847.396802:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568847.396830:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958482048 00000100:00100000:1.0:1788568847.396850:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958482048 00000100:00100000:1.0:1788568847.396902:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958482304 00000100:00100000:1.0:1788568847.396906:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958482304 00000100:00100000:1.0:1788568847.396967:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 12 00000100:00100000:1.0:1788568847.396976:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+5:2361:x1875449958482048:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:1.0:1788568847.397044:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+5:2361:x1875449958482048:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 69us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568847.397051:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 12 00000100:00100000:1.0:1788568847.397067:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 13 00000100:00100000:1.0:1788568847.397074:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+5:2361:x1875449958482304:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:1.0:1788568847.397113:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+5:2361:x1875449958482304:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 39us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568847.397119:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 13 00000100:00080000:1.0:1788568847.397143:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788568847.397148:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788568847.401834:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fb8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54c998a2-cb2f-4cd7-8309-f29c84f83a13+13:2361:x1875449958481664:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 14401us (14921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568847.401854:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 120 00010000:00010000:0.0:1788568847.613214:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568848.631201:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568849.400715:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788568849.400740:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae251dc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976301184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788568849.400808:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568849.401061:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976301184 00000100:00100000:2.0:1788568849.401069:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976301184 00000100:00100000:2.0:1788568849.401175:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788568849.401185:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976301184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788568849.401219:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788568849.401283:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875449976301184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568849.401290:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788568849.401333:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae251dc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875449976301184:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788568849.401880:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788568849.420692:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568849.420756:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958482560 00000100:00100000:1.0:1788568849.420765:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958482560 00000100:00080000:2.0:1788568849.420852:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788568849.420856:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 15 00000100:00100000:1.0:1788568849.420869:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+6:14432:x1875449958482560:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788568849.420895:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568849.420919:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a219f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bef63 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.421013:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a21a6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.421026:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a21a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.421038:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a21a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.421052:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a21ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.421058:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a21ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.421065:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a21ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.421527:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a21b4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.421537:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a21b4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.421558:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a21b4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568849.421580:0:14423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788568849.421583:0:14423:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788568849.421613:0:14423:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a21b4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.421633:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a21a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.421640:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a21a6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.421647:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a21a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.421652:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2c800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568849.421656:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a21a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.421663:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a21a6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.421674:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae256682e00) 00010000:00010000:1.0:1788568849.421677:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568849.421682:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a21a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.421688:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a21a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.421698:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a21ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.421704:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a21ad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.421710:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a21ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.421720:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2dc00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568849.421723:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a21ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.421730:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a21ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.421737:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9ae25d03e500) 00010000:00010000:1.0:1788568849.421739:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568849.421741:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a21ad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.421748:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a21ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.421777:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a219f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef63 expref: 8 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.421789:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d400/0x41e82f464b6a21b4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef63 expref: 7 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.421796:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ae25d03e400) 00010000:00010000:1.0:1788568849.421798:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788568849.421800:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2d400, rc 0) 00000100:00100000:1.0:1788568849.421862:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+7:14432:x1875449958482560:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 996us (1178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568849.421869:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 15 00000100:00100000:3.0:1788568849.437397:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568849.437867:0:16402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958482816 00000100:00100000:1.0:1788568849.437897:0:16402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958482816 00000100:00100000:1.0:1788568849.438019:0:16402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 16 00000100:00100000:1.0:1788568849.438032:0:16402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+7:14432:x1875449958482816:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788568849.438057:0:16402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568849.438082:0:16402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a21bb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bef6a expref: -99 pid: 16402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.438193:0:16402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a21c2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.438210:0:16402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a21c2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.438224:0:16402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a21c2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.438866:0:16402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a21c9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.438887:0:16402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a21c9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.438901:0:16402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a21c9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.439815:0:16402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a21d0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.439830:0:16402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a21d0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.439839:0:16402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a21d0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568849.439857:0:16402:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788568849.446360:0:16402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a21c2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.446384:0:16402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a21c2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.446393:0:16402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a21c2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.446400:0:16402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2dc00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568849.447525:0:16402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a21c2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.447973:0:16402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a21c2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.447993:0:16402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ae25d03e400) 00010000:00010000:1.0:1788568849.447996:0:16402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568849.448001:0:16402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a21c2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.448009:0:16402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a21c2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.448282:0:16402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a21c9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.448290:0:16402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a21c9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.448330:0:16402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a21c9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.448335:0:16402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2c800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568849.448338:0:16402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a21c9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.448345:0:16402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a21c9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.448354:0:16402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ae25d03e500) 00010000:00010000:1.0:1788568849.448357:0:16402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568849.448361:0:16402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a21c9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.448366:0:16402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a21c9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.450392:0:16402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a21bb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef6a expref: 10 pid: 16402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.450416:0:16402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c200/0x41e82f464b6a21d0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef6a expref: 9 pid: 16402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.450425:0:16402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ae25d03e100) 00010000:00010000:1.0:1788568849.450428:0:16402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568849.450431:0:16402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2c200, rc 0) 00000100:00100000:1.0:1788568849.450569:0:16402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+9:14432:x1875449958482816:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 12538us (13185us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788568849.450587:0:16402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 16 00000100:00100000:2.0:1788568849.468894:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568849.469000:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958482944 00000100:00100000:3.0:1788568849.469010:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958482944 00000100:00100000:3.0:1788568849.469061:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 17 00000100:00100000:3.0:1788568849.469071:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+9:14432:x1875449958482944:12345-192.168.206.4@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788568849.469162:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+9:14432:x1875449958482944:12345-192.168.206.4@tcp:59:lhsmtool_posix.0 Request processed in 92us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568849.469170:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 17 00000100:00100000:2.0:1788568849.519035:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568849.519176:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958483072 00000100:00100000:1.0:1788568849.519185:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958483072 00000100:00100000:1.0:1788568849.519240:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 18 00000100:00100000:1.0:1788568849.519249:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+9:14438:x1875449958483072:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:1.0:1788568849.519266:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568849.519294:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a21de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bef71 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.519359:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a21e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.519373:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a21e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.519392:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a21e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.519405:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a21ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.519412:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a21ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.519419:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a21ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.519603:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a21e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.519621:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a21e5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.519628:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a21e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.519634:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2c800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568849.519639:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a21e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.519646:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a21e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.519658:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae256682e00) 00010000:00010000:1.0:1788568849.519661:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568849.519665:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a21e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.519672:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a21e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.519683:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a21ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.519689:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a21ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.519694:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a21ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.519699:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2dc00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568849.519708:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a21ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.519715:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a21ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.519724:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ae25d03e500) 00010000:00010000:1.0:1788568849.519726:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568849.519730:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a21ec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.519736:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a21ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.519764:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a21de lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef71 expref: 10 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.519774:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae256682e00) 00010000:00010000:1.0:1788568849.519777:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568849.519781:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a21de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef71 expref: 10 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.519790:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2d000, rc 0) 00000100:00100000:1.0:1788568849.519849:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+9:14438:x1875449958483072:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 601us (821us total) trans 0 rc 301/301 00000100:00100000:1.0:1788568849.519857:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 18 00000100:00100000:2.0:1788568849.534063:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568849.534918:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958483200 00000100:00100000:3.0:1788568849.535001:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958483200 00000100:00100000:3.0:1788568849.535096:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 0 00000100:00100000:3.0:1788568849.535108:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+9:14438:x1875449958483200:12345-192.168.206.4@tcp:700:lfs.0 00000100:00100000:3.0:1788568849.535196:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+9:14438:x1875449958483200:12345-192.168.206.4@tcp:700:lfs.0 Request processed in 90us (1140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568849.535204:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 0 00000100:00100000:2.0:1788568849.538064:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568849.538468:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958483456 00000100:00100000:3.0:1788568849.538477:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958483456 00000100:00100000:3.0:1788568849.538737:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 19 00000100:00100000:3.0:1788568849.538749:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+9:14438:x1875449958483456:12345-192.168.206.4@tcp:36:lfs.0 00010000:00010000:3.0:1788568849.538796:0:14421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568849.538818:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147000/0x41e82f464b6a2121 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beeec expref: 9 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568849.538857:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae256682e00) 00010000:00010000:3.0:1788568849.538863:0:14421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788568849.539092:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a21f3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568849.539108:0:14421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146a00/0x41e82f464b6a2159 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef4e expref: 5 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568849.539117:0:14421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a21f3 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568849.539162:0:14421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146a00/0x41e82f464b6a2159 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef4e expref: 5 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568849.539177:0:14421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146a00/0x41e82f464b6a2159 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef4e expref: 5 pid: 14422 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568849.539191:0:14421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2526d7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14421:1875449976301312:192.168.206.4@tcp:104: 00000100:00100000:3.0:1788568849.539262:0:14421:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae250ac8180 going to sleep for 11 seconds 00000100:00100000:3.0:1788568849.542795:0:14421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2526d7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14421:1875449976301312:192.168.206.4@tcp:104: 00010000:00010000:3.0:1788568849.542822:0:14421:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a21f3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568849.544031:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568849.544284:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958483584 00000100:00100000:0.0:1788568849.544292:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958483584 00010000:00010000:0.0:1788568849.544427:0:14408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146a00/0x41e82f464b6a2159 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef4e expref: 6 pid: 14422 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568849.544467:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 9 00000100:00100000:0.0:1788568849.544476:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+6:2363:x1875449958483584:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788568849.544496:0:14408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568849.544503:0:14408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146a00/0x41e82f464b6a2159 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef4e expref: 6 pid: 14422 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568849.544516:0:14408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146a00/0x41e82f464b6a2159 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef4e expref: 6 pid: 14422 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568849.544569:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146a00/0x41e82f464b6a2159 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef4e expref: 6 pid: 14422 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568849.544584:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae256682e00) 00010000:00010000:0.0:1788568849.544589:0:14408:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a21f3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568849.544598:0:14408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a21f3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568849.544605:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a21f3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568849.544632:0:14408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788568849.544675:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+5:2363:x1875449958483584:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 200us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568849.544683:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 9 00010000:00010000:3.0:1788568849.545016:0:14421:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a21f3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568849.545026:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a21f3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568849.545053:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a21fa lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568849.545062:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a21fa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568849.545070:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a21fa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788568849.546145:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:3.0:1788568849.546297:0:14421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788568849.546309:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a21f3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568849.546318:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a21f3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568849.546325:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a21f3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568849.546331:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429dec00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568849.546336:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a21f3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568849.546344:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a21f3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568849.546357:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae256682e00) 00010000:00010000:3.0:1788568849.546360:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788568849.546364:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a21f3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568849.546381:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a21f3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788568849.546399:0:14421:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba5d7bf5 reply state 0000000032cbd0e5 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a21fa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568849.546408:0:14421:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788568849.546491:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+10:14438:x1875449958483456:12345-192.168.206.4@tcp:36:lfs.0 Request processed in 7742us (8433us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788568849.546499:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 19 00010000:00010000:1.0:1788568849.548903:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a21fa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.548920:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a21fa lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.548973:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a21fa lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.548980:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429de800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568849.548984:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a21fa lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.548993:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a21fa lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.549007:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ae2430ad300) 00010000:00010000:1.0:1788568849.549011:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568849.549016:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a21fa lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.549023:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a21fa lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568849.626486:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568849.628490:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958483712 00000100:00100000:1.0:1788568849.628502:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958483712 00000100:00100000:1.0:1788568849.628573:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 20 00000100:00100000:1.0:1788568849.628583:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+9:14446:x1875449958483712:12345-192.168.206.4@tcp:101:lctl.0 00010000:00010000:1.0:1788568849.628604:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568849.628637:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a2201 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bef78 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.628698:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a2208 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.628728:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a2208 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.628742:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a2208 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568849.628778:0:14422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788568849.628782:0:14422:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788568849.628817:0:14422:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a2208 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.628992:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a2201 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef78 expref: 11 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.629010:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2dc00/0x41e82f464b6a2208 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef78 expref: 10 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.629019:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae25d03e500) 00010000:00010000:1.0:1788568849.629022:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788568849.629025:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2dc00, rc 0) 00000100:00100000:1.0:1788568849.629154:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+10:14446:x1875449958483712:12345-192.168.206.4@tcp:101:lctl.0 Request processed in 572us (2676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568849.629162:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 20 00010000:00010000:0.0:1788568849.656052:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568849.659085:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568849.659354:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958483840 00000100:00100000:1.0:1788568849.659363:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958483840 00000100:00100000:1.0:1788568849.659453:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 21 00000100:00100000:1.0:1788568849.659463:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+5:14447:x1875449958483840:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:1.0:1788568849.659482:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568849.659511:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a220f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bef7f expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.659578:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a2216 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.659592:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a2216 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.659604:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a2216 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568849.659633:0:14423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788568849.659636:0:14423:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788568849.659657:0:14423:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a2216 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.659680:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2d000/0x41e82f464b6a220f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef7f expref: 7 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.659697:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c800/0x41e82f464b6a2216 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef7f expref: 6 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.659705:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae25d03e500) 00010000:00010000:1.0:1788568849.659708:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788568849.659712:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae273b2c800, rc 0) 00000100:00100000:1.0:1788568849.659764:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+6:14447:x1875449958483840:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 303us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568849.659779:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 21 00000100:00100000:3.0:1788568849.662648:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568849.662711:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958483968 00000100:00100000:1.0:1788568849.662733:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958483968 00000100:00100000:1.0:1788568849.662792:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 22 00000100:00100000:1.0:1788568849.662803:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+6:14447:x1875449958483968:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:1.0:1788568849.662821:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568849.662839:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a221d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bef86 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.662895:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a2224 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.662908:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a2224 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.662918:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a2224 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.664107:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a222b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.664124:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a222b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.664133:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a222b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.664280:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01800/0x41e82f464b6a2232 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.664289:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01800/0x41e82f464b6a2232 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.664297:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01800/0x41e82f464b6a2232 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568849.664334:0:14422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788568849.664338:0:14422:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788568849.664357:0:14422:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01800/0x41e82f464b6a2232 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.664368:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a2224 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.664374:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a2224 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.664380:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a2224 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.664385:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2de00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568849.664390:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a2224 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.664396:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a2224 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.664408:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae25d03e500) 00010000:00010000:1.0:1788568849.664411:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568849.664416:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a2224 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.664424:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2de00/0x41e82f464b6a2224 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.664436:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a222b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.664465:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a222b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.664472:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a222b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.664476:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae273b2c600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568849.664479:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a222b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.664485:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a222b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.664492:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ae25d03e800) 00010000:00010000:1.0:1788568849.664495:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568849.664498:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a222b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.664503:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c600/0x41e82f464b6a222b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.664550:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae273b2c000/0x41e82f464b6a221d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef86 expref: 8 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.664564:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01800/0x41e82f464b6a2232 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef86 expref: 7 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.664571:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ae25d03e700) 00010000:00010000:1.0:1788568849.664573:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788568849.664582:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae277a01800, rc 0) 00000100:00100000:1.0:1788568849.664655:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+7:14447:x1875449958483968:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 1853us (2014us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568849.664663:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 22 00000100:00100000:0.0:1788568849.684715:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568849.684852:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958484224 00000100:00100000:3.0:1788568849.684862:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958484224 00000100:00100000:3.0:1788568849.684917:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 23 00000100:00100000:3.0:1788568849.684970:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+7:14447:x1875449958484224:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:3.0:1788568849.684999:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568849.685020:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a2239 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bef8d expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788568849.685104:0:14421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788568849.685225:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a2239 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef8d expref: 9 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568849.685240:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae25d03e500) 00010000:00010000:3.0:1788568849.685243:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788568849.685248:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a2239 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef8d expref: 9 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568849.685291:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429dec00, rc 0) 00000100:00100000:3.0:1788568849.685351:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+8:14447:x1875449958484224:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 425us (646us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1788568849.685359:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 23 00000100:00100000:3.0:1788568849.691064:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568849.691217:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958484480 00000100:00100000:1.0:1788568849.691227:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958484480 00000100:00100000:1.0:1788568849.691294:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 24 00000100:00100000:1.0:1788568849.691304:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+8:14447:x1875449958484480:12345-192.168.206.4@tcp:36:lfs.0 00010000:00010000:1.0:1788568849.691355:0:14422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788568849.691382:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01800/0x41e82f464b6a2232 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef86 expref: 8 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.691399:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ae25d03e700) 00010000:00010000:1.0:1788568849.691410:0:14422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788568849.691432:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00400/0x41e82f464b6a2247 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.691456:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00400/0x41e82f464b6a2247 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.691466:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00400/0x41e82f464b6a2247 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788568849.691679:0:14422:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dc46e3a3 reply state 00000000df06c9d0 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00400/0x41e82f464b6a2247 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568849.691688:0:14422:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788568849.691695:0:14422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788568849.691774:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+9:14447:x1875449958484480:12345-192.168.206.4@tcp:36:lfs.0 Request processed in 471us (718us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788568849.691796:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 24 00010000:00010000:0.0:1788568849.695682:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00400/0x41e82f464b6a2247 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568849.695699:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00400/0x41e82f464b6a2247 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568849.695707:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00400/0x41e82f464b6a2247 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568849.695728:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae277a00400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568849.695733:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00400/0x41e82f464b6a2247 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568849.695740:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00400/0x41e82f464b6a2247 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568849.695755:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ae25d03e800) 00010000:00010000:0.0:1788568849.695757:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788568849.695761:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00400/0x41e82f464b6a2247 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568849.695767:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00400/0x41e82f464b6a2247 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568849.698485:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568849.699602:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958484736 00000100:00100000:1.0:1788568849.699614:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958484736 00000100:00100000:1.0:1788568849.699677:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 2 00000100:00100000:1.0:1788568849.699687:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+8:14447:x1875449958484736:12345-192.168.206.4@tcp:35:lfs.0 00000100:00100000:1.0:1788568849.699900:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+9:14447:x1875449958484736:12345-192.168.206.4@tcp:35:lfs.0 Request processed in 213us (1424us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788568849.699908:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 2 00000100:00100000:2.0:1788568849.704054:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568849.704195:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958484992 00000100:00100000:3.0:1788568849.704204:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958484992 00000100:00100000:3.0:1788568849.704263:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 25 00000100:00100000:3.0:1788568849.704287:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+9:14447:x1875449958484992:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:3.0:1788568849.704308:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568849.704325:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a224e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bef94 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568849.704394:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de400/0x41e82f464b6a2255 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568849.704407:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de400/0x41e82f464b6a2255 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568849.704418:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de400/0x41e82f464b6a2255 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568849.704433:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfa00/0x41e82f464b6a225c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568849.704440:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfa00/0x41e82f464b6a225c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568849.704474:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfa00/0x41e82f464b6a225c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788568849.704581:0:14421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788568849.704657:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de400/0x41e82f464b6a2255 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568849.704665:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de400/0x41e82f464b6a2255 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568849.704672:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de400/0x41e82f464b6a2255 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568849.704678:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429de400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568849.704682:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de400/0x41e82f464b6a2255 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568849.704690:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de400/0x41e82f464b6a2255 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568849.704701:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae25d03e500) 00010000:00010000:3.0:1788568849.704704:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788568849.704708:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de400/0x41e82f464b6a2255 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568849.704715:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de400/0x41e82f464b6a2255 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568849.704727:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfa00/0x41e82f464b6a225c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568849.704743:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfa00/0x41e82f464b6a225c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568849.704749:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfa00/0x41e82f464b6a225c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568849.704754:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429dfa00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568849.704757:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfa00/0x41e82f464b6a225c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568849.704763:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfa00/0x41e82f464b6a225c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568849.704771:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ae2430ad200) 00010000:00010000:3.0:1788568849.704774:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788568849.704777:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfa00/0x41e82f464b6a225c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568849.704783:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfa00/0x41e82f464b6a225c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568849.704818:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a224e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef94 expref: 11 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568849.704829:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae25d03e500) 00010000:00010000:3.0:1788568849.704831:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788568849.704835:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a224e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef94 expref: 11 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568849.704854:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429dec00, rc 0) 00000100:00100000:3.0:1788568849.704919:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+10:14447:x1875449958484992:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 634us (874us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1788568849.704956:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 25 00000100:00100000:0.0:1788568849.712325:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568849.712426:0:16402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958485120 00000100:00100000:2.0:1788568849.712436:0:16402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958485120 00000100:00100000:2.0:1788568849.712508:0:16402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 26 00000100:00100000:2.0:1788568849.712518:0:16402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+10:14447:x1875449958485120:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:2.0:1788568849.712550:0:16402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568849.712574:0:16402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae142d6a800/0x41e82f464b6a226a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bef9b expref: -99 pid: 16402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568849.712652:0:16402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae142d6be00/0x41e82f464b6a2271 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568849.712666:0:16402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae142d6be00/0x41e82f464b6a2271 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568849.712679:0:16402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae142d6be00/0x41e82f464b6a2271 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788568849.712717:0:16402:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788568849.712721:0:16402:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788568849.712739:0:16402:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae142d6be00/0x41e82f464b6a2271 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568849.712763:0:16402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae142d6a800/0x41e82f464b6a226a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef9b expref: 12 pid: 16402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568849.712781:0:16402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae142d6be00/0x41e82f464b6a2271 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef9b expref: 11 pid: 16402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568849.712790:0:16402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ae24a9c0d00) 00010000:00010000:2.0:1788568849.712793:0:16402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788568849.712797:0:16402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae142d6be00, rc 0) 00000100:00100000:2.0:1788568849.712860:0:16402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+11:14447:x1875449958485120:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 343us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568849.712867:0:16402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 26 00000100:00100000:2.0:1788568849.718222:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568849.718321:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958485248 00000100:00100000:1.0:1788568849.718330:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958485248 00000100:00100000:1.0:1788568849.718386:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 3 00000100:00100000:1.0:1788568849.718398:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+11:14447:x1875449958485248:12345-192.168.206.4@tcp:37:lfs.0 00000100:00100000:2.0:1788568849.748083:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+11:14447:x1875449958485248:12345-192.168.206.4@tcp:37:lfs.0 Request processed in 29678us (29861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568849.748097:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 3 00000100:00100000:0.0:1788568849.757379:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568849.763323:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958485504 00000100:00100000:2.0:1788568849.763339:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958485504 00000100:00100000:2.0:1788568849.763414:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 4 00000100:00100000:2.0:1788568849.763424:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2530d9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+11:14447:x1875449958485504:12345-192.168.206.4@tcp:35:lfs.0 00000100:00100000:2.0:1788568849.763653:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2530d9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+12:14447:x1875449958485504:12345-192.168.206.4@tcp:35:lfs.0 Request processed in 231us (6285us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788568849.763675:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 4 00000100:00100000:3.0:1788568849.906655:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568849.907013:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958485632 00000100:00100000:1.0:1788568849.907023:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958485632 00000100:00100000:1.0:1788568849.907084:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 27 00000100:00100000:1.0:1788568849.907095:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+10:14453:x1875449958485632:12345-192.168.206.4@tcp:101:bash.0 00010000:00010000:1.0:1788568849.907113:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568849.907132:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01800/0x41e82f464b6a2278 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9befa2 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.907194:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00e00/0x41e82f464b6a227f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.907208:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00e00/0x41e82f464b6a227f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.907220:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00e00/0x41e82f464b6a227f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.907250:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01a00/0x41e82f464b6a2286 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.907257:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01a00/0x41e82f464b6a2286 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.907264:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01a00/0x41e82f464b6a2286 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.907360:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01000/0x41e82f464b6a228d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.907374:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01000/0x41e82f464b6a228d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.907381:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01000/0x41e82f464b6a228d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568849.907407:0:14421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788568849.907411:0:14421:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788568849.907446:0:14421:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01000/0x41e82f464b6a228d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.907457:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00e00/0x41e82f464b6a227f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.907463:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00e00/0x41e82f464b6a227f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.907469:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00e00/0x41e82f464b6a227f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.907484:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae277a00e00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568849.907497:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00e00/0x41e82f464b6a227f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.907506:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00e00/0x41e82f464b6a227f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.907517:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae25d03e500) 00010000:00010000:1.0:1788568849.907520:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568849.907524:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00e00/0x41e82f464b6a227f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.907531:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00e00/0x41e82f464b6a227f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.907553:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01a00/0x41e82f464b6a2286 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.907560:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01a00/0x41e82f464b6a2286 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.907573:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01a00/0x41e82f464b6a2286 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.907578:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae277a01a00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568849.907581:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01a00/0x41e82f464b6a2286 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.907587:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01a00/0x41e82f464b6a2286 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.907604:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ae25d03e700) 00010000:00010000:1.0:1788568849.907607:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568849.907610:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01a00/0x41e82f464b6a2286 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.907615:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01a00/0x41e82f464b6a2286 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.907645:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01800/0x41e82f464b6a2278 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befa2 expref: 12 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.907656:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01000/0x41e82f464b6a228d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befa2 expref: 11 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.907663:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ae24a9c0d00) 00010000:00010000:1.0:1788568849.907664:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788568849.907667:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae277a01000, rc 0) 00000100:00100000:1.0:1788568849.910172:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+11:14453:x1875449958485632:12345-192.168.206.4@tcp:101:bash.0 Request processed in 646us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568849.910187:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 27 00000100:00100000:0.0:1788568849.912193:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568849.912401:0:16402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958485888 00000100:00100000:1.0:1788568849.912411:0:16402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958485888 00000100:00100000:1.0:1788568849.912467:0:16402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 28 00000100:00100000:1.0:1788568849.912478:0:16402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+11:14453:x1875449958485888:12345-192.168.206.4@tcp:101:bash.0 00010000:00010000:1.0:1788568849.912507:0:16402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568849.912527:0:16402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01e00/0x41e82f464b6a2294 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9befa9 expref: -99 pid: 16402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.912690:0:16402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00800/0x41e82f464b6a229b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.912706:0:16402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae142d6be00/0x41e82f464b6a2271 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef9b expref: 11 pid: 16402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.912714:0:16402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00800/0x41e82f464b6a229b lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.912745:0:16402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae142d6be00/0x41e82f464b6a2271 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef9b expref: 11 pid: 16402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.912758:0:16402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae142d6be00/0x41e82f464b6a2271 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef9b expref: 11 pid: 16402 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568849.912770:0:16402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16402:1875449976301440:192.168.206.4@tcp:104: 00000100:00100000:1.0:1788568849.912854:0:16402:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2530760c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788568849.918735:0:16402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16402:1875449976301440:192.168.206.4@tcp:104: 00010000:00010000:1.0:1788568849.918778:0:16402:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00800/0x41e82f464b6a229b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568849.926654:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568849.927285:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958486016 00000100:00100000:2.0:1788568849.927296:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958486016 00010000:00010000:2.0:1788568849.927334:0:14407:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae142d6be00/0x41e82f464b6a2271 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef9b expref: 12 pid: 16402 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568849.927379:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 10 00000100:00100000:2.0:1788568849.927389:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+12:2363:x1875449958486016:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788568849.927419:0:14407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568849.927427:0:14407:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae142d6be00/0x41e82f464b6a2271 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef9b expref: 12 pid: 16402 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568849.927442:0:14407:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae142d6be00/0x41e82f464b6a2271 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef9b expref: 12 pid: 16402 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568849.927464:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae142d6be00/0x41e82f464b6a2271 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bef9b expref: 12 pid: 16402 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568849.927482:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ae24a9c0d00) 00010000:00010000:2.0:1788568849.927500:0:14407:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00800/0x41e82f464b6a229b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568849.927510:0:14407:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00800/0x41e82f464b6a229b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568849.927518:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00800/0x41e82f464b6a229b lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568849.927625:0:14407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568849.927687:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+11:2363:x1875449958486016:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 298us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568849.927695:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 10 00010000:00010000:1.0:1788568849.930220:0:16402:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00800/0x41e82f464b6a229b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.930237:0:16402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00800/0x41e82f464b6a229b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.938871:0:16402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01800/0x41e82f464b6a22a2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.938917:0:16402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01800/0x41e82f464b6a22a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.940317:0:16402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01800/0x41e82f464b6a22a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568849.941372:0:16402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146600/0x41e82f464b6a22a9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568849.941387:0:16402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146600/0x41e82f464b6a22a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568849.941397:0:16402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146600/0x41e82f464b6a22a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788568849.941408:0:16402:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788568849.941436:0:16402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00800/0x41e82f464b6a229b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568849.941451:0:16402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00800/0x41e82f464b6a229b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568849.941458:0:16402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00800/0x41e82f464b6a229b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568849.941464:0:16402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae277a00800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568849.941468:0:16402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00800/0x41e82f464b6a229b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568849.941475:0:16402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00800/0x41e82f464b6a229b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568849.941487:0:16402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ae24a9c0d00) 00010000:00010000:0.0:1788568849.941490:0:16402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788568849.941494:0:16402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00800/0x41e82f464b6a229b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568849.941499:0:16402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00800/0x41e82f464b6a229b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788568849.941512:0:16402:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000046751a64 reply state 00000000868b45c3 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01800/0x41e82f464b6a22a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568849.941520:0:16402:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788568849.941566:0:16402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01e00/0x41e82f464b6a2294 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befa9 expref: 14 pid: 16402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568849.941581:0:16402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146600/0x41e82f464b6a22a9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befa9 expref: 13 pid: 16402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568849.941599:0:16402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae256682d00) 00010000:00010000:0.0:1788568849.941601:0:16402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788568849.941604:0:16402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae253146600, rc 0) 00000100:00100000:0.0:1788568849.941683:0:16402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+14:14453:x1875449958485888:12345-192.168.206.4@tcp:101:bash.0 Request processed in 29205us (29496us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788568849.941690:0:16402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 28 00010000:00010000:1.0:1788568849.945760:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01800/0x41e82f464b6a22a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.945776:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01800/0x41e82f464b6a22a2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.945783:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01800/0x41e82f464b6a22a2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.945789:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae277a01800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568849.945794:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01800/0x41e82f464b6a22a2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.945801:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01800/0x41e82f464b6a22a2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.945817:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9ae25d03e700) 00010000:00010000:1.0:1788568849.945821:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568849.945825:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01800/0x41e82f464b6a22a2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568849.945833:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01800/0x41e82f464b6a22a2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568849.986023:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568849.986286:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958486144 00000100:00100000:0.0:1788568849.986296:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958486144 00000100:00100000:0.0:1788568849.986353:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 29 00000100:00100000:0.0:1788568849.986363:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+13:14453:x1875449958486144:12345-192.168.206.4@tcp:101:bash.0 00010000:00010000:0.0:1788568849.986386:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568849.986405:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147200/0x41e82f464b6a22b7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9befb0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568849.986480:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146e00/0x41e82f464b6a22be lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568849.986502:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146e00/0x41e82f464b6a22be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568849.986514:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146e00/0x41e82f464b6a22be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788568849.986557:0:14423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788568849.986561:0:14423:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788568849.986580:0:14423:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146e00/0x41e82f464b6a22be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568849.986607:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146e00/0x41e82f464b6a22be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568849.986636:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147200/0x41e82f464b6a22b7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befb0 expref: 15 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568849.986654:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146e00/0x41e82f464b6a22be lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befb0 expref: 14 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568849.986662:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae256682d00) 00010000:00010000:0.0:1788568849.986665:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788568849.986669:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae253146e00, rc 0) 00000100:00100000:0.0:1788568849.986724:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+14:14453:x1875449958486144:12345-192.168.206.4@tcp:101:bash.0 Request processed in 362us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568849.986731:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 29 00000100:00100000:0.0:1788568850.001162:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568850.001315:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958486400 00000100:00100000:2.0:1788568850.001324:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958486400 00000100:00100000:2.0:1788568850.001378:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 5 00000100:00100000:2.0:1788568850.001389:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+14:14453:x1875449958486400:12345-192.168.206.4@tcp:35:bash.0 00000100:00100000:2.0:1788568850.002190:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+15:14453:x1875449958486400:12345-192.168.206.4@tcp:35:bash.0 Request processed in 799us (1032us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788568850.002200:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 5 00000040:00080000:0.0:1788568850.041158:0:14454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788568850.134484:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568850.134601:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958486656 00000100:00100000:1.0:1788568850.134620:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958486656 00000100:00100000:1.0:1788568850.134673:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 30 00000100:00100000:1.0:1788568850.134682:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+15:14463:x1875449958486656:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:1.0:1788568850.134701:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568850.134717:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01800/0x41e82f464b6a22c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9befb7 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568850.134807:0:14422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788568850.134904:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01800/0x41e82f464b6a22c5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befb7 expref: 17 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.134918:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae25d03e500) 00010000:00010000:1.0:1788568850.134921:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788568850.134955:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01800/0x41e82f464b6a22c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befb7 expref: 17 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.134968:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae277a01800, rc 0) 00000100:00100000:1.0:1788568850.135023:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+16:14463:x1875449958486656:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 341us (547us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1788568850.135029:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 30 00000100:00100000:3.0:1788568850.138717:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568850.138879:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958486912 00000100:00100000:2.0:1788568850.138890:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958486912 00000100:00100000:2.0:1788568850.138987:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 6 00000100:00100000:2.0:1788568850.138998:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+16:14463:x1875449958486912:12345-192.168.206.4@tcp:35:lfs.0 00000100:00100000:2.0:1788568850.139251:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+17:14463:x1875449958486912:12345-192.168.206.4@tcp:35:lfs.0 Request processed in 254us (541us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788568850.139259:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 6 00000100:00100000:0.0:1788568850.188558:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568850.188740:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958487168 00000100:00100000:1.0:1788568850.188750:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958487168 00000100:00100000:1.0:1788568850.188817:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 31 00000100:00100000:1.0:1788568850.188828:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+17:14466:x1875449958487168:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:1.0:1788568850.188850:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568850.188869:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01800/0x41e82f464b6a22d3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9befbe expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.189004:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01a00/0x41e82f464b6a22da lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.189018:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01a00/0x41e82f464b6a22da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.189029:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01a00/0x41e82f464b6a22da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568850.189039:0:14423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788568850.189152:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01800/0x41e82f464b6a22d3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befbe expref: 20 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.189169:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01a00/0x41e82f464b6a22da lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befbe expref: 19 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.189177:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae256682d00) 00010000:00010000:1.0:1788568850.189179:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788568850.189182:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae277a01a00, rc 0) 00000100:00100000:1.0:1788568850.189239:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+19:14466:x1875449958487168:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 413us (699us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1788568850.189246:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 31 00000100:00100000:3.0:1788568850.192849:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568850.192893:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568850.193105:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958487424 00000100:00100000:1.0:1788568850.193114:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958487424 00000100:00100000:1.0:1788568850.193173:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 0 00000100:00100000:1.0:1788568850.193184:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+19:2363:x1875449958487424:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788568850.193198:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788568850.193233:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01a00/0x41e82f464b6a22da lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befbe expref: 19 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.193251:0:14406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae256682d00) 00010000:00010000:1.0:1788568850.193256:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788568850.193314:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+18:2363:x1875449958487424:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 131us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568850.193322:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 0 00000100:00100000:0.0:1788568850.193804:0:16402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958487296 00000100:00100000:0.0:1788568850.193810:0:16402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958487296 00000100:00100000:0.0:1788568850.193847:0:16402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 32 00000100:00100000:0.0:1788568850.193855:0:16402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+18:14466:x1875449958487296:12345-192.168.206.4@tcp:54:lfs.0 00010000:00010000:0.0:1788568850.193909:0:16402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147000/0x41e82f464b6a22e8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568850.193923:0:16402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147000/0x41e82f464b6a22e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568850.193967:0:16402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147000/0x41e82f464b6a22e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568850.193993:0:16402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147000/0x41e82f464b6a22e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568850.194000:0:16402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147000/0x41e82f464b6a22e8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568850.194007:0:16402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147000/0x41e82f464b6a22e8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568850.194012:0:16402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae253147000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568850.194017:0:16402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147000/0x41e82f464b6a22e8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568850.194024:0:16402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147000/0x41e82f464b6a22e8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568850.194033:0:16402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae256682d00) 00010000:00010000:0.0:1788568850.194036:0:16402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788568850.194040:0:16402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147000/0x41e82f464b6a22e8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568850.194046:0:16402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147000/0x41e82f464b6a22e8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568850.194095:0:16402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+18:14466:x1875449958487296:12345-192.168.206.4@tcp:54:lfs.0 Request processed in 239us (1255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568850.194102:0:16402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 32 00000100:00100000:3.0:1788568850.197307:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568850.197394:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958487680 00000100:00100000:0.0:1788568850.197404:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958487680 00000100:00100000:0.0:1788568850.197451:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 7 00000100:00100000:0.0:1788568850.197460:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+18:14466:x1875449958487680:12345-192.168.206.4@tcp:35:lfs.0 00000100:00100000:0.0:1788568850.197701:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+19:14466:x1875449958487680:12345-192.168.206.4@tcp:35:lfs.0 Request processed in 242us (401us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788568850.197708:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 7 00000100:00100000:3.0:1788568850.491689:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568850.491967:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958487936 00000100:00100000:1.0:1788568850.491978:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958487936 00000100:00100000:1.0:1788568850.492033:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 33 00000100:00100000:1.0:1788568850.492043:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+19:14497:x1875449958487936:12345-192.168.206.4@tcp:101:cat.0 00010000:00010000:1.0:1788568850.492064:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568850.492083:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01a00/0x41e82f464b6a22ef lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9befc5 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.492174:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01800/0x41e82f464b6a22f6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.492188:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01800/0x41e82f464b6a22f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.492200:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01800/0x41e82f464b6a22f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568850.492211:0:14423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788568850.492364:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01a00/0x41e82f464b6a22ef lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befc5 expref: 22 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.492397:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01800/0x41e82f464b6a22f6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befc5 expref: 21 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.492406:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae256682d00) 00010000:00010000:1.0:1788568850.492409:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788568850.492412:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae277a01800, rc 0) 00000100:00100000:1.0:1788568850.492486:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+21:14497:x1875449958487936:12345-192.168.206.4@tcp:101:cat.0 Request processed in 443us (806us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1788568850.492493:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 33 00000100:00100000:3.0:1788568850.498601:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568850.501761:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958488192 00000100:00100000:0.0:1788568850.501775:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958488192 00000100:00100000:0.0:1788568850.501961:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 8 00000100:00100000:0.0:1788568850.501973:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+21:14497:x1875449958488192:12345-192.168.206.4@tcp:35:cat.0 00000100:00100000:0.0:1788568850.502656:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+22:14497:x1875449958488192:12345-192.168.206.4@tcp:35:cat.0 Request processed in 683us (4061us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1788568850.502666:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 8 00000100:00100000:0.0:1788568850.508458:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568850.508686:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958488320 00000100:00100000:2.0:1788568850.508697:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958488320 00000100:00100000:2.0:1788568850.508762:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 1 00000100:00100000:2.0:1788568850.508773:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+22:2364:x1875449958488320:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788568850.508799:0:14408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568850.508823:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01800/0x41e82f464b6a22f6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befc5 expref: 22 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568850.508858:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae256682d00) 00010000:00010000:2.0:1788568850.508864:0:14408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568850.508920:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+21:2364:x1875449958488320:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 148us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568850.508967:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 1 00000100:00100000:3.0:1788568850.631056:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568850.631155:0:16402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958488576 00000100:00100000:0.0:1788568850.631166:0:16402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958488576 00000100:00100000:0.0:1788568850.631228:0:16402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 34 00000100:00100000:0.0:1788568850.631238:0:16402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+21:14503:x1875449958488576:12345-192.168.206.4@tcp:101:dd.0 00010000:00010000:0.0:1788568850.631262:0:16402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568850.631284:0:16402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146a00/0x41e82f464b6a2304 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9befcc expref: -99 pid: 16402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568850.631378:0:16402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147000/0x41e82f464b6a230b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568850.631391:0:16402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147000/0x41e82f464b6a230b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568850.631418:0:16402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147000/0x41e82f464b6a230b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788568850.631430:0:16402:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788568850.632183:0:16402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146a00/0x41e82f464b6a2304 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befcc expref: 24 pid: 16402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568850.632203:0:16402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147000/0x41e82f464b6a230b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befcc expref: 23 pid: 16402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568850.632211:0:16402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae256682d00) 00010000:00010000:0.0:1788568850.632214:0:16402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788568850.632217:0:16402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae253147000, rc 0) 00000100:00100000:0.0:1788568850.632283:0:16402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+23:14503:x1875449958488576:12345-192.168.206.4@tcp:101:dd.0 Request processed in 1046us (1236us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1788568850.632291:0:16402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 34 00000100:00100000:3.0:1788568850.649290:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568850.649454:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958488832 00000100:00100000:1.0:1788568850.649463:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958488832 00000100:00100000:1.0:1788568850.649529:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 35 00000100:00100000:1.0:1788568850.649549:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+23:14503:x1875449958488832:12345-192.168.206.4@tcp:36:dd.0 00010000:00010000:1.0:1788568850.649625:0:14423:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788568850.649650:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147000/0x41e82f464b6a230b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befcc expref: 23 pid: 16402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.649670:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146e00/0x41e82f464b6a22be lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befb0 expref: 22 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.649680:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae256682d00) 00010000:00010000:1.0:1788568850.649685:0:14423:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788568850.650566:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01a00/0x41e82f464b6a2319 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.650583:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01a00/0x41e82f464b6a2319 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.650712:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01a00/0x41e82f464b6a2319 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788568850.650772:0:14423:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1788568850.652112:0:14423:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000074cb181f reply state 00000000d121f351 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01a00/0x41e82f464b6a2319 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568850.652125:0:14423:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788568850.652245:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+24:14503:x1875449958488832:12345-192.168.206.4@tcp:36:dd.0 Request processed in 2703us (2961us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1788568850.652253:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 35 00000020:00080000:1.0:1788568850.652258:0:14423:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788568850.664758:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01a00/0x41e82f464b6a2319 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568850.664775:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01a00/0x41e82f464b6a2319 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568850.664791:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01a00/0x41e82f464b6a2319 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568850.664798:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae277a01a00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568850.664802:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01a00/0x41e82f464b6a2319 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568850.664826:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01a00/0x41e82f464b6a2319 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568850.664842:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae256682d00) 00010000:00010000:0.0:1788568850.664845:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788568850.664850:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01a00/0x41e82f464b6a2319 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568850.664855:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01a00/0x41e82f464b6a2319 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568850.680527:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568850.794991:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568850.795202:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958489088 00000100:00100000:1.0:1788568850.795213:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958489088 00000100:00100000:3.0:1788568850.795492:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 9 00000100:00100000:3.0:1788568850.795503:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+23:14503:x1875449958489088:12345-192.168.206.4@tcp:35:dd.0 00000100:00100000:3.0:1788568850.795735:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+24:14503:x1875449958489088:12345-192.168.206.4@tcp:35:dd.0 Request processed in 233us (751us total) trans 8589934611 rc 0/0 00000100:00100000:3.0:1788568850.795743:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 9 00000100:00100000:3.0:1788568850.959997:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568850.960194:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958489216 00000100:00100000:1.0:1788568850.960207:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958489216 00000100:00100000:1.0:1788568850.960277:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 36 00000100:00100000:1.0:1788568850.960287:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+24:14517:x1875449958489216:12345-192.168.206.4@tcp:101:stat.0 00010000:00010000:1.0:1788568850.960308:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568850.960326:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01c00/0x41e82f464b6a2320 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9befd3 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.960384:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00000/0x41e82f464b6a2327 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.960397:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00000/0x41e82f464b6a2327 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.960407:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00000/0x41e82f464b6a2327 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.960434:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00200/0x41e82f464b6a232e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.960440:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00200/0x41e82f464b6a232e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.960459:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00200/0x41e82f464b6a232e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.960542:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01600/0x41e82f464b6a2335 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.960551:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01600/0x41e82f464b6a2335 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.960559:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01600/0x41e82f464b6a2335 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568850.960589:0:14422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788568850.960592:0:14422:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788568850.962812:0:14422:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01600/0x41e82f464b6a2335 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.962832:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01600/0x41e82f464b6a2335 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.962842:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00000/0x41e82f464b6a2327 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.962849:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00000/0x41e82f464b6a2327 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.962865:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00000/0x41e82f464b6a2327 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.962871:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae277a00000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568850.962875:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00000/0x41e82f464b6a2327 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.962884:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00000/0x41e82f464b6a2327 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.962897:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ae24a9c0d00) 00010000:00010000:1.0:1788568850.962901:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568850.962905:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00000/0x41e82f464b6a2327 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.962912:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00000/0x41e82f464b6a2327 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.963756:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00200/0x41e82f464b6a232e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.963769:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00200/0x41e82f464b6a232e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.963775:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00200/0x41e82f464b6a232e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.963781:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae277a00200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568850.963784:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00200/0x41e82f464b6a232e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.963804:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00200/0x41e82f464b6a232e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.963815:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9ae25d03e700) 00010000:00010000:1.0:1788568850.963818:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568850.963821:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00200/0x41e82f464b6a232e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.963828:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00200/0x41e82f464b6a232e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.963872:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01c00/0x41e82f464b6a2320 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befd3 expref: 26 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.963886:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01600/0x41e82f464b6a2335 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befd3 expref: 25 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568850.963894:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae256682d00) 00010000:00010000:1.0:1788568850.963896:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788568850.963899:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae277a01600, rc 0) 00000100:00100000:1.0:1788568850.963997:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+25:14517:x1875449958489216:12345-192.168.206.4@tcp:101:stat.0 Request processed in 3710us (4014us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568850.964005:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 36 00000100:00100000:1.0:1788568851.036172:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568851.036382:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958489472 00000100:00100000:0.0:1788568851.036396:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958489472 00000100:00100000:0.0:1788568851.036492:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 37 00000100:00100000:0.0:1788568851.036506:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+25:14523:x1875449958489472:12345-192.168.206.4@tcp:36:truncate.0 00010000:00010000:0.0:1788568851.036582:0:14423:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568851.036615:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01600/0x41e82f464b6a2335 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befd3 expref: 25 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568851.036638:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae256682d00) 00010000:00010000:0.0:1788568851.036645:0:14423:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788568851.036921:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147e00/0x41e82f464b6a233c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788568851.037067:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788568851.037617:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147e00/0x41e82f464b6a233c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568851.037633:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147e00/0x41e82f464b6a233c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788568851.037757:0:14423:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:0.0:1788568851.037797:0:14423:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000df296638 reply state 000000008a030bfa transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147e00/0x41e82f464b6a233c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568851.037807:0:14423:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788568851.037986:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+27:14523:x1875449958489472:12345-192.168.206.4@tcp:36:truncate.0 Request processed in 1480us (1823us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1788568851.037995:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 37 00000020:00080000:0.0:1788568851.038001:0:14423:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788568851.042227:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147e00/0x41e82f464b6a233c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568851.042263:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147e00/0x41e82f464b6a233c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568851.042510:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147e00/0x41e82f464b6a233c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568851.042517:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae253147e00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568851.042524:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147e00/0x41e82f464b6a233c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568851.042544:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147e00/0x41e82f464b6a233c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568851.042567:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae256682d00) 00010000:00010000:1.0:1788568851.042571:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568851.042577:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147e00/0x41e82f464b6a233c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568851.042584:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147e00/0x41e82f464b6a233c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568851.245859:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568851.246155:0:16402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958489600 00000100:00100000:0.0:1788568851.246169:0:16402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958489600 00000100:00100000:0.0:1788568851.246244:0:16402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 38 00000100:00100000:0.0:1788568851.246256:0:16402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+26:14537:x1875449958489600:12345-192.168.206.4@tcp:101:stat.0 00010000:00010000:0.0:1788568851.246286:0:16402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568851.246312:0:16402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147a00/0x41e82f464b6a2343 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9befda expref: -99 pid: 16402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568851.246397:0:16402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147200/0x41e82f464b6a234a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568851.246414:0:16402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147200/0x41e82f464b6a234a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568851.246428:0:16402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147200/0x41e82f464b6a234a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568851.246446:0:16402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147e00/0x41e82f464b6a2351 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568851.246556:0:16402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147e00/0x41e82f464b6a2351 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568851.246565:0:16402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147e00/0x41e82f464b6a2351 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568851.246670:0:16402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146e00/0x41e82f464b6a2358 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568851.246680:0:16402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146e00/0x41e82f464b6a2358 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568851.246688:0:16402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146e00/0x41e82f464b6a2358 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788568851.246730:0:16402:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1788568851.246735:0:16402:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788568851.246764:0:16402:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146e00/0x41e82f464b6a2358 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568851.246778:0:16402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146e00/0x41e82f464b6a2358 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568851.246787:0:16402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147200/0x41e82f464b6a234a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568851.246989:0:16402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147200/0x41e82f464b6a234a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568851.246998:0:16402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147200/0x41e82f464b6a234a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568851.247014:0:16402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae253147200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568851.247019:0:16402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147200/0x41e82f464b6a234a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568851.247028:0:16402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147200/0x41e82f464b6a234a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568851.247043:0:16402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ae24a9c0d00) 00010000:00010000:0.0:1788568851.247046:0:16402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788568851.247051:0:16402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147200/0x41e82f464b6a234a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568851.247058:0:16402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147200/0x41e82f464b6a234a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568851.247074:0:16402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147e00/0x41e82f464b6a2351 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568851.247081:0:16402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147e00/0x41e82f464b6a2351 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568851.247087:0:16402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147e00/0x41e82f464b6a2351 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568851.247409:0:16402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae253147e00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568851.247415:0:16402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147e00/0x41e82f464b6a2351 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568851.247423:0:16402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147e00/0x41e82f464b6a2351 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568851.247443:0:16402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9ae256682f00) 00010000:00010000:0.0:1788568851.247446:0:16402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788568851.247449:0:16402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147e00/0x41e82f464b6a2351 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568851.247456:0:16402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147e00/0x41e82f464b6a2351 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568851.247579:0:16402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147a00/0x41e82f464b6a2343 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befda expref: 28 pid: 16402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568851.247593:0:16402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146e00/0x41e82f464b6a2358 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befda expref: 27 pid: 16402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568851.247602:0:16402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae256682d00) 00010000:00010000:0.0:1788568851.247604:0:16402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788568851.247607:0:16402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae253146e00, rc 0) 00000100:00100000:0.0:1788568851.247686:0:16402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+27:14537:x1875449958489600:12345-192.168.206.4@tcp:101:stat.0 Request processed in 1430us (1842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568851.247694:0:16402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 38 00000100:00100000:3.0:1788568851.401409:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568851.401599:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958489856 00000100:00100000:0.0:1788568851.401612:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958489856 00000100:00100000:0.0:1788568851.401703:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 39 00000100:00100000:0.0:1788568851.401716:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+27:14547:x1875449958489856:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:0.0:1788568851.401741:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568851.401768:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147a00/0x41e82f464b6a235f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9befe1 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568851.402061:0:14423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788568851.402517:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147a00/0x41e82f464b6a235f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befe1 expref: 29 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568851.402546:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae25d03e500) 00010000:00010000:1.0:1788568851.402550:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788568851.402556:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147a00/0x41e82f464b6a235f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befe1 expref: 29 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568851.402574:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae253147a00, rc 0) 00000100:00100000:1.0:1788568851.402669:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+28:14547:x1875449958489856:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 954us (1273us total) trans 8589934614 rc 301/301 00000100:00100000:1.0:1788568851.402678:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 39 00000100:00100000:2.0:1788568851.409437:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568851.409836:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958490112 00000100:00100000:0.0:1788568851.409850:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958490112 00000100:00100000:0.0:1788568851.409962:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 10 00000100:00100000:0.0:1788568851.409976:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2530d8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+28:14547:x1875449958490112:12345-192.168.206.4@tcp:35:lfs.0 00000100:00100000:0.0:1788568851.410299:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2530d8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+29:14547:x1875449958490112:12345-192.168.206.4@tcp:35:lfs.0 Request processed in 317us (866us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1788568851.410307:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 10 00000100:00100000:1.0:1788568851.451440:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976301824:0@lo:400:kworker.0 00000100:00100000:1.0:1788568851.451551:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568851.451635:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788568851.451643:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976301696:0@lo:400:kworker.0 00000100:00100000:1.0:1788568851.451669:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568851.451695:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875449976302208:0@lo:400:kworker.0 00000100:00100000:1.0:1788568851.451721:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568851.451754:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976301824 00000100:00100000:1.0:1788568851.451764:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976301824 00000100:00100000:1.0:1788568851.451826:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976301696 00000100:00100000:1.0:1788568851.451829:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976301696 00000100:00100000:1.0:1788568851.451851:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788568851.451860:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976301824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568851.451918:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976301824:12345-0@lo:400:kworker.0 Request processed in 58us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568851.451942:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788568851.451958:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788568851.451965:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976301696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568851.452005:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976301696:12345-0@lo:400:kworker.0 Request processed in 41us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568851.452012:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788568851.452210:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273aa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bbee97af-a6b0-4265-8c9f-26b826a76798:3309:1875449976301568:0@lo:400:kworker.0 00000100:00100000:3.0:1788568851.452269:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568851.452309:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875449976302080:0@lo:400:kworker.0 00000100:00100000:3.0:1788568851.452331:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568851.452353:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788568851.452359:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875449976301952:0@lo:400:kworker.0 00000100:00100000:3.0:1788568851.452379:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568851.452407:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976301568 00000100:00100000:3.0:1788568851.452412:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976301568 00000100:00100000:3.0:1788568851.452444:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788568851.452451:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fb8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+19:3309:x1875449976301568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568851.452485:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fb8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbee97af-a6b0-4265-8c9f-26b826a76798+19:3309:x1875449976301568:12345-0@lo:400:kworker.0 Request processed in 34us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568851.452491:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788568851.452562:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273aa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bbee97af-a6b0-4265-8c9f-26b826a76798:3309:1875449976301568:0@lo:400:kworker.0 00000100:00100000:3.0:1788568851.452590:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976302208 00000100:00100000:3.0:1788568851.452593:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976302208 00000100:00100000:3.0:1788568851.452622:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976302080 00000100:00100000:3.0:1788568851.452625:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976302080 00000100:00100000:3.0:1788568851.452638:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976301952 00000100:00100000:3.0:1788568851.452639:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976301952 00000100:00100000:3.0:1788568851.452651:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788568851.452656:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875449976302208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568851.452695:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875449976302208:12345-0@lo:400:kworker.0 Request processed in 38us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568851.452702:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788568851.452714:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788568851.452721:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875449976302080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568851.452762:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875449976302080:12345-0@lo:400:kworker.0 Request processed in 41us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568851.452768:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788568851.452794:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875449976302080:0@lo:400:kworker.0 00000100:00100000:3.0:1788568851.452813:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788568851.452819:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875449976301952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568851.452849:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875449976301952:12345-0@lo:400:kworker.0 Request processed in 30us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568851.452854:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788568851.452876:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875449976301952:0@lo:400:kworker.0 00000100:00080000:3.0:1788568851.452951:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788568851.452957:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788568851.452960:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788568851.453452:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244b37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976302336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788568851.453495:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568851.453557:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976301696:0@lo:400:kworker.0 00000100:00100000:1.0:1788568851.453570:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875449976302208:0@lo:400:kworker.0 00000100:00100000:1.0:1788568851.453580:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976301824:0@lo:400:kworker.0 00000100:00100000:1.0:1788568851.453624:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976302336 00000100:00100000:1.0:1788568851.453629:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976302336 00000100:00100000:1.0:1788568851.453665:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788568851.453673:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976302336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788568851.453709:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788568851.453751:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976302336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568851.453758:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788568851.453792:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244b37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976302336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788568851.519393:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568851.519740:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958490368 00000100:00100000:3.0:1788568851.519753:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958490368 00000100:00100000:3.0:1788568851.520013:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 40 00000100:00100000:3.0:1788568851.520026:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+29:14553:x1875449958490368:12345-192.168.206.4@tcp:101:bash.0 00010000:00010000:3.0:1788568851.520053:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568851.520078:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfa00/0x41e82f464b6a236d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9befe8 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568851.520412:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a2374 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568851.520430:0:14421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146600/0x41e82f464b6a22a9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befa9 expref: 30 pid: 16402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568851.520640:0:14421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146e00/0x41e82f464b6a2358 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befda expref: 30 pid: 16402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568851.520649:0:14421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a2374 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568851.520689:0:14421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146e00/0x41e82f464b6a2358 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befda expref: 30 pid: 16402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568851.520706:0:14421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146e00/0x41e82f464b6a2358 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befda expref: 30 pid: 16402 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568851.520723:0:14421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244b35880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14421:1875449976302464:192.168.206.4@tcp:104: 00010000:00010000:3.0:1788568851.521044:0:14421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146600/0x41e82f464b6a22a9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befa9 expref: 30 pid: 16402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568851.521054:0:14421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146600/0x41e82f464b6a22a9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befa9 expref: 30 pid: 16402 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568851.521063:0:14421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244b34e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14421:1875449976302592:192.168.206.4@tcp:104: 00000100:00100000:3.0:1788568851.521089:0:14421:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae250ac8780 going to sleep for 11 seconds 00000100:00100000:3.0:1788568851.526172:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568851.526213:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568851.528385:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958490496 00000100:00100000:3.0:1788568851.528404:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958490496 00000100:00100000:1.0:1788568851.529004:0:14421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244b35880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14421:1875449976302464:192.168.206.4@tcp:104: 00000100:00100000:1.0:1788568851.529020:0:14421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244b34e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14421:1875449976302592:192.168.206.4@tcp:104: 00010000:00010000:1.0:1788568851.529053:0:14421:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a2374 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568851.529239:0:14408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146e00/0x41e82f464b6a2358 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befda expref: 31 pid: 16402 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568851.529983:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958490624 00000100:00100000:3.0:1788568851.529992:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958490624 00010000:00010000:3.0:1788568851.530022:0:14408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146600/0x41e82f464b6a22a9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befa9 expref: 32 pid: 16402 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568851.530458:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 11 00000100:00100000:1.0:1788568851.530473:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae277921050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+32:2364:x1875449958490496:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788568851.530502:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788568851.530511:0:14406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146e00/0x41e82f464b6a2358 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befda expref: 32 pid: 16402 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568851.530527:0:14406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146e00/0x41e82f464b6a2358 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befda expref: 32 pid: 16402 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568851.530578:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146e00/0x41e82f464b6a2358 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befda expref: 32 pid: 16402 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568851.530597:0:14406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae256682d00) 00010000:00010000:1.0:1788568851.530602:0:14406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a2374 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568851.530613:0:14406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a2374 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568851.530621:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788568851.530714:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae277921050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+31:2364:x1875449958490496:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 246us (4557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568851.530723:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 11 00000100:00100000:1.0:1788568851.530782:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 12 00000100:00100000:1.0:1788568851.530789:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+30:2364:x1875449958490624:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788568851.530798:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788568851.530802:0:14406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146600/0x41e82f464b6a22a9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befa9 expref: 30 pid: 16402 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568851.530812:0:14406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146600/0x41e82f464b6a22a9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befa9 expref: 30 pid: 16402 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568851.530825:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253146600/0x41e82f464b6a22a9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befa9 expref: 30 pid: 16402 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568851.531045:0:14406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae256682d00) 00010000:00010000:1.0:1788568851.531049:0:14406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a2374 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568851.531058:0:14406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a2374 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568851.531076:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a2374 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568851.531103:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788568851.531124:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+29:2364:x1875449958490624:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 336us (4911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568851.531141:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 12 00010000:00010000:1.0:1788568851.531170:0:14421:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a2374 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568851.531178:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a2374 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568851.531199:0:14421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:1.0:1788568851.531428:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfa00/0x41e82f464b6a236d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befe8 expref: 30 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568851.531453:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a2374 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befe8 expref: 29 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568851.531461:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae256682d00) 00010000:00010000:1.0:1788568851.531472:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788568851.531735:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429dec00, rc 0) 00000100:00100000:1.0:1788568851.531783:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+29:14553:x1875449958490368:12345-192.168.206.4@tcp:101:bash.0 Request processed in 11759us (12404us total) trans 8589934616 rc 0/0 00000100:00100000:1.0:1788568851.531798:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 40 00000100:00100000:0.0:1788568851.536317:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568851.536498:0:16402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958490880 00000100:00100000:2.0:1788568851.536510:0:16402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958490880 00000100:00100000:2.0:1788568851.536590:0:16402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 41 00000100:00100000:2.0:1788568851.536614:0:16402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+29:14553:x1875449958490880:12345-192.168.206.4@tcp:36:bash.0 00010000:00010000:2.0:1788568851.537001:0:16402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae142d6ba00/0x41e82f464b6a2382 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568851.537023:0:16402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae142d6ba00/0x41e82f464b6a2382 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568851.537037:0:16402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae142d6ba00/0x41e82f464b6a2382 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788568851.537097:0:16402:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:2.0:1788568851.537124:0:16402:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000030980128 reply state 000000002c07ebf2 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae142d6ba00/0x41e82f464b6a2382 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568851.537133:0:16402:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788568851.537237:0:16402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+32:14553:x1875449958490880:12345-192.168.206.4@tcp:36:bash.0 Request processed in 634us (934us total) trans 8589934618 rc 0/0 00000100:00100000:2.0:1788568851.537278:0:16402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 41 00000020:00080000:2.0:1788568851.537286:0:16402:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788568851.541860:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae142d6ba00/0x41e82f464b6a2382 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568851.541883:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae142d6ba00/0x41e82f464b6a2382 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568851.541892:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae142d6ba00/0x41e82f464b6a2382 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568851.541900:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae142d6ba00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568851.541905:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae142d6ba00/0x41e82f464b6a2382 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568851.541913:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae142d6ba00/0x41e82f464b6a2382 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568851.541960:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae256682d00) 00010000:00010000:2.0:1788568851.541964:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788568851.541971:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae142d6ba00/0x41e82f464b6a2382 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568851.541978:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae142d6ba00/0x41e82f464b6a2382 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568851.542121:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568851.542223:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958491008 00000100:00100000:1.0:1788568851.542235:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958491008 00000100:00100000:1.0:1788568851.542321:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 42 00000100:00100000:1.0:1788568851.542347:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+31:14553:x1875449958491008:12345-192.168.206.4@tcp:101:bash.0 00010000:00010000:1.0:1788568851.542416:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568851.542438:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01c00/0x41e82f464b6a2389 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9befef expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568851.543072:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01c00/0x41e82f464b6a2389 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befef expref: 32 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568851.543092:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01c00/0x41e82f464b6a2389 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befef expref: 32 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568851.543122:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae256682d00) 00010000:00010000:1.0:1788568851.543133:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788568851.543136:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae277a01c00, rc 0) 00000100:00100000:1.0:1788568851.543242:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+32:14553:x1875449958491008:12345-192.168.206.4@tcp:101:bash.0 Request processed in 896us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568851.543251:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 42 00000100:00100000:0.0:1788568851.558744:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568851.558847:0:16402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958491136 00000100:00100000:2.0:1788568851.558861:0:16402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958491136 00000100:00100000:2.0:1788568851.558968:0:16402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 43 00000100:00100000:2.0:1788568851.558981:0:16402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+32:14553:x1875449958491136:12345-192.168.206.4@tcp:101:bash.0 00010000:00010000:2.0:1788568851.559030:0:16402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568851.559057:0:16402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae142d6b000/0x41e82f464b6a2390 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beff6 expref: -99 pid: 16402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568851.559162:0:16402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae142d6be00/0x41e82f464b6a2397 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568851.559179:0:16402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a2374 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befe8 expref: 33 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568851.559189:0:16402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae142d6be00/0x41e82f464b6a2397 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568851.559231:0:16402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a2374 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befe8 expref: 33 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568851.559245:0:16402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a2374 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befe8 expref: 33 pid: 14421 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568851.559273:0:16402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae281709180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16402:1875449976302720:192.168.206.4@tcp:104: 00000100:00100000:2.0:1788568851.559379:0:16402:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24481f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788568851.568438:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568851.568733:0:16402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae281709180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16402:1875449976302720:192.168.206.4@tcp:104: 00010000:00010000:2.0:1788568851.568778:0:16402:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae142d6be00/0x41e82f464b6a2397 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568851.568870:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958491264 00000100:00100000:3.0:1788568851.568879:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958491264 00010000:00010000:3.0:1788568851.568971:0:14407:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a2374 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befe8 expref: 34 pid: 14421 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568851.569019:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 13 00000100:00100000:3.0:1788568851.569031:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae251dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+34:2364:x1875449958491264:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788568851.569048:0:14407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568851.569055:0:14407:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a2374 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befe8 expref: 34 pid: 14421 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568851.569069:0:14407:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a2374 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befe8 expref: 34 pid: 14421 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568851.569094:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a2374 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befe8 expref: 34 pid: 14421 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568851.569112:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae256682d00) 00010000:00010000:3.0:1788568851.569117:0:14407:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae142d6be00/0x41e82f464b6a2397 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568851.569138:0:14407:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae142d6be00/0x41e82f464b6a2397 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568851.569163:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae142d6be00/0x41e82f464b6a2397 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568851.569193:0:14407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788568851.569250:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+33:2364:x1875449958491264:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 222us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568851.569258:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 13 00010000:00010000:2.0:1788568851.569395:0:16402:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae142d6be00/0x41e82f464b6a2397 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568851.569403:0:16402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae142d6be00/0x41e82f464b6a2397 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788568851.569464:0:16402:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788568851.569469:0:16402:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788568851.569505:0:16402:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae142d6be00/0x41e82f464b6a2397 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568851.569553:0:16402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae142d6b000/0x41e82f464b6a2390 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beff6 expref: 33 pid: 16402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568851.569569:0:16402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae142d6be00/0x41e82f464b6a2397 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beff6 expref: 32 pid: 16402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568851.569576:0:16402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae256682d00) 00010000:00010000:2.0:1788568851.569579:0:16402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788568851.569582:0:16402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae142d6be00, rc 0) 00000100:00100000:2.0:1788568851.569612:0:16402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae251dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+32:14553:x1875449958491136:12345-192.168.206.4@tcp:101:bash.0 Request processed in 10635us (10883us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568851.569620:0:16402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 43 00000100:00100000:1.0:1788568851.575813:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568851.576049:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958491520 00000100:00100000:3.0:1788568851.576063:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958491520 00000100:00100000:3.0:1788568851.576138:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 2 00000100:00100000:3.0:1788568851.576151:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+32:14553:x1875449958491520:12345-192.168.206.4@tcp:103:bash.0 00010000:00010000:3.0:1788568851.576172:0:14408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788568851.576202:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae142d6be00/0x41e82f464b6a2397 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beff6 expref: 32 pid: 16402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568851.576227:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01c00/0x41e82f464b6a2389 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9befef expref: 31 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568851.576239:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae256682d00) 00010000:00010000:3.0:1788568851.576251:0:14408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788568851.576312:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+30:14553:x1875449958491520:12345-192.168.206.4@tcp:103:bash.0 Request processed in 164us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568851.576320:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 2 00000100:00100000:0.0:1788568851.584035:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568851.584132:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958491648 00000100:00100000:1.0:1788568851.584161:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958491648 00000100:00100000:1.0:1788568851.584235:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 44 00000100:00100000:1.0:1788568851.584250:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+30:14553:x1875449958491648:12345-192.168.206.4@tcp:58:bash.0 00010000:00010000:1.0:1788568851.584389:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00000/0x41e82f464b6a239e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568851.584410:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00000/0x41e82f464b6a239e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568851.584423:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00000/0x41e82f464b6a239e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788568851.586636:0:14423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788568851.586801:0:14423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1788568851.588211:0:14423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1788568851.588831:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+30:14553:x1875449958491648:12345-192.168.206.4@tcp:58:bash.0 Request processed in 4575us (4801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568851.588856:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 44 00000100:00100000:0.0:1788568851.592047:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568851.592276:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958491776 00000100:00100000:3.0:1788568851.592290:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958491776 00000100:00100000:3.0:1788568851.592369:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 45 00000100:00100000:3.0:1788568851.592382:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+30:14553:x1875449958491776:12345-192.168.206.4@tcp:101:bash.0 00010000:00010000:3.0:1788568851.592423:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568851.592459:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a23a5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9beffd expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568851.592554:0:14422:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00000/0x41e82f464b6a239e lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568851.592568:0:14422:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a23a5 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beffd expref: 31 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568851.592591:0:14422:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00000/0x41e82f464b6a239e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568851.592604:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a23a5 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beffd expref: 31 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568851.592621:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae25d03e700) 00010000:00010000:3.0:1788568851.592624:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788568851.592628:0:14422:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a23a5 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beffd expref: 31 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568851.592636:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429dec00, rc 0) 00000100:00100000:3.0:1788568851.592707:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+31:14553:x1875449958491776:12345-192.168.206.4@tcp:101:bash.0 Request processed in 328us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568851.592714:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 45 00010000:00010000:0.0:1788568851.703283:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788568852.088306:0:14454:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788568852.088317:0:14454:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788568852.088372:0:14454:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788568852.088379:0:14454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788568852.088543:0:14454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2526d7b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14454:1875449976302848:192.168.206.4@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788568852.088684:0:14454:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae250af9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788568852.104162:0:14454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2526d7b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14454:1875449976302848:192.168.206.4@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788568852.104522:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568852.105470:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958491904 00000100:00100000:0.0:1788568852.105493:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958491904 00000100:00100000:0.0:1788568852.105578:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 0 00000100:00100000:0.0:1788568852.105590:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+31:14554:x1875449958491904:12345-192.168.206.4@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788568852.105700:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+31:14554:x1875449958491904:12345-192.168.206.4@tcp:900:lhsmtool_posix.0 Request processed in 112us (1180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568852.105727:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 0 00000100:00100000:0.0:1788568852.112346:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568852.112679:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958492032 00000100:00100000:1.0:1788568852.112691:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958492032 00000100:00100000:1.0:1788568852.112794:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 46 00000100:00100000:1.0:1788568852.112806:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+31:14554:x1875449958492032:12345-192.168.206.4@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788568852.112856:0:14421:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788568852.113040:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+31:14554:x1875449958492032:12345-192.168.206.4@tcp:53:lhsmtool_posix.0 Request processed in 237us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568852.113048:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 46 00000100:00100000:2.0:1788568852.132551:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568852.132725:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958492160 00000100:00100000:1.0:1788568852.132737:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958492160 00000100:00100000:1.0:1788568852.132810:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 47 00000100:00100000:1.0:1788568852.132820:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+31:14554:x1875449958492160:12345-192.168.206.4@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788568852.132914:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00a00/0x41e82f464b6a23ac lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.132954:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00a00/0x41e82f464b6a23ac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.132968:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00a00/0x41e82f464b6a23ac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.133131:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00600/0x41e82f464b6a23b3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.133154:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00600/0x41e82f464b6a23b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.133167:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00600/0x41e82f464b6a23b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.133198:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01400/0x41e82f464b6a23ba lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.133208:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01400/0x41e82f464b6a23ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.133217:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01400/0x41e82f464b6a23ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788568852.133261:0:14421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788568852.133265:0:14421:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788568852.133343:0:14421:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01400/0x41e82f464b6a23ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.133366:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00a00/0x41e82f464b6a23ac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.133372:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00a00/0x41e82f464b6a23ac lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.133379:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00a00/0x41e82f464b6a23ac lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.133384:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae277a00a00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568852.133388:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00a00/0x41e82f464b6a23ac lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.133395:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00a00/0x41e82f464b6a23ac lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.133407:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ae25d03e100) 00010000:00010000:1.0:1788568852.133410:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568852.133639:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00a00/0x41e82f464b6a23ac lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.133648:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00a00/0x41e82f464b6a23ac lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.133664:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00600/0x41e82f464b6a23b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.133671:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00600/0x41e82f464b6a23b3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.133677:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00600/0x41e82f464b6a23b3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.133689:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae277a00600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568852.133692:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00600/0x41e82f464b6a23b3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.133699:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00600/0x41e82f464b6a23b3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.134754:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9ae25d03e800) 00010000:00010000:1.0:1788568852.134760:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568852.134765:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00600/0x41e82f464b6a23b3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.134773:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00600/0x41e82f464b6a23b3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.134806:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01400/0x41e82f464b6a23ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.134813:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01400/0x41e82f464b6a23ba lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.134818:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01400/0x41e82f464b6a23ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.134824:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae277a01400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568852.134827:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01400/0x41e82f464b6a23ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.134833:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01400/0x41e82f464b6a23ba lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.134852:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae25d03e700) 00010000:00010000:1.0:1788568852.134855:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568852.134858:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01400/0x41e82f464b6a23ba lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.134864:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01400/0x41e82f464b6a23ba lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568852.134966:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+31:14554:x1875449958492160:12345-192.168.206.4@tcp:34:lhsmtool_posix.0 Request processed in 2144us (2435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568852.134974:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 47 00000100:00100000:3.0:1788568852.138663:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568852.138890:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958492416 00000100:00100000:1.0:1788568852.138904:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958492416 00000100:00100000:3.0:1788568852.139353:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 48 00000100:00100000:3.0:1788568852.139370:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+31:14554:x1875449958492416:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788568852.139397:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568852.139426:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de400/0x41e82f464b6a23c1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bf004 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.139732:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfa00/0x41e82f464b6a23c8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.139750:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfa00/0x41e82f464b6a23c8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.139762:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfa00/0x41e82f464b6a23c8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788568852.139775:0:14422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788568852.140740:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfa00/0x41e82f464b6a23c8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.140755:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfa00/0x41e82f464b6a23c8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.140762:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfa00/0x41e82f464b6a23c8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.140769:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429dfa00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568852.140774:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfa00/0x41e82f464b6a23c8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.140783:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfa00/0x41e82f464b6a23c8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.140818:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae25d03e700) 00010000:00010000:3.0:1788568852.140821:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788568852.140826:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfa00/0x41e82f464b6a23c8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.140833:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfa00/0x41e82f464b6a23c8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.143006:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de400/0x41e82f464b6a23c1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf004 expref: 33 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.143041:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ae25d03e100) 00010000:00010000:3.0:1788568852.143045:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788568852.143050:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de400/0x41e82f464b6a23c1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf004 expref: 33 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.143069:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429de400, rc 0) 00000100:00100000:3.0:1788568852.143168:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+32:14554:x1875449958492416:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 3801us (4516us total) trans 8589934619 rc 301/301 00000100:00100000:3.0:1788568852.143179:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 48 00000100:00100000:2.0:1788568852.153236:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568852.153667:0:16402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958492544 00000100:00100000:3.0:1788568852.153680:0:16402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958492544 00000100:00100000:3.0:1788568852.153751:0:16402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 49 00000100:00100000:3.0:1788568852.153764:0:16402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+32:14554:x1875449958492544:12345-192.168.206.4@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788568852.153808:0:16402:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788568852.153969:0:16402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+32:14554:x1875449958492544:12345-192.168.206.4@tcp:53:lhsmtool_posix.0 Request processed in 207us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568852.153994:0:16402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 49 00000100:00100000:2.0:1788568852.159006:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568852.159579:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958492800 00000100:00100000:3.0:1788568852.159593:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958492800 00000100:00100000:3.0:1788568852.159657:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 50 00000100:00100000:3.0:1788568852.159668:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+32:14554:x1875449958492800:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788568852.159695:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568852.159721:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de400/0x41e82f464b6a23d6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bf00b expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788568852.160557:0:14423:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:3.0:1788568852.160567:0:14423:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:3.0:1788568852.160629:0:14423:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:3.0:1788568852.160993:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfa00/0x41e82f464b6a23dd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.161012:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfa00/0x41e82f464b6a23dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.161025:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfa00/0x41e82f464b6a23dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.161098:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de400/0x41e82f464b6a23d6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf00b expref: 35 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.161119:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfa00/0x41e82f464b6a23dd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf00b expref: 34 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.161129:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ae2430ad200) 00010000:00010000:3.0:1788568852.161140:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788568852.161145:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2429dfa00, rc 0) 00000100:00100000:3.0:1788568852.161232:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+34:14554:x1875449958492800:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 1563us (2236us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1788568852.161241:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 50 00000100:00100000:0.0:1788568852.166487:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568852.167269:0:16402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958493056 00000100:00100000:3.0:1788568852.167285:0:16402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958493056 00000100:00100000:3.0:1788568852.167358:0:16402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 51 00000100:00100000:3.0:1788568852.167369:0:16402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2526d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+34:14554:x1875449958493056:12345-192.168.206.4@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788568852.167441:0:16402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568852.167475:0:16402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dfa00/0x41e82f464b6a23dd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf00b expref: 34 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.167497:0:16402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ae2430ad200) 00010000:00010000:3.0:1788568852.167511:0:16402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788568852.167550:0:16402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a23eb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.167567:0:16402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a23eb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.167578:0:16402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a23eb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.167596:0:16402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044200/0x41e82f464b6a23f2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xaa6ddfc5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.167604:0:16402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044200/0x41e82f464b6a23f2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xaa6ddfc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.167634:0:16402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044200/0x41e82f464b6a23f2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xaa6ddfc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.167720:0:16402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a23eb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.167728:0:16402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a23eb lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.167735:0:16402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a23eb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.167741:0:16402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2429de800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568852.167745:0:16402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a23eb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.167753:0:16402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a23eb lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.167762:0:16402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ae24a9c0d00) 00010000:00010000:3.0:1788568852.167765:0:16402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788568852.167769:0:16402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a23eb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.167775:0:16402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429de800/0x41e82f464b6a23eb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.167784:0:16402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044200/0x41e82f464b6a23f2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xaa6ddfc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.167790:0:16402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044200/0x41e82f464b6a23f2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xaa6ddfc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.167801:0:16402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044200/0x41e82f464b6a23f2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xaa6ddfc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.167806:0:16402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae282044200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568852.167809:0:16402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044200/0x41e82f464b6a23f2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xaa6ddfc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.167815:0:16402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044200/0x41e82f464b6a23f2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xaa6ddfc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.167822:0:16402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xaa6ddfc5 (ffff9ae2430ad600) 00010000:00010000:3.0:1788568852.167824:0:16402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788568852.167827:0:16402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044200/0x41e82f464b6a23f2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xaa6ddfc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.167833:0:16402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044200/0x41e82f464b6a23f2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xaa6ddfc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568852.172290:0:16402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2526d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+33:14554:x1875449958493056:12345-192.168.206.4@tcp:36:lhsmtool_posix.0 Request processed in 4903us (5808us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788568852.172306:0:16402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 51 00000100:00100000:2.0:1788568852.184453:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568852.184614:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958493184 00000100:00100000:3.0:1788568852.184627:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958493184 00000100:00100000:3.0:1788568852.184746:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 52 00000100:00100000:3.0:1788568852.184758:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+33:14554:x1875449958493184:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788568852.184787:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568852.184818:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045600/0x41e82f464b6a23f9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bf012 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.184873:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044400/0x41e82f464b6a2400 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.184909:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044400/0x41e82f464b6a2400 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.184923:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044400/0x41e82f464b6a2400 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.185082:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045600/0x41e82f464b6a23f9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf012 expref: 35 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.185102:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044400/0x41e82f464b6a2400 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf012 expref: 34 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.185112:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ae2430ad000) 00010000:00010000:3.0:1788568852.185115:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788568852.185119:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae282044400, rc 0) 00000100:00100000:3.0:1788568852.185189:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+34:14554:x1875449958493184:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 433us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568852.185196:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 52 00000100:00100000:1.0:1788568852.195450:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568852.195874:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958493440 00000100:00100000:3.0:1788568852.195888:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958493440 00000100:00100000:3.0:1788568852.195984:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 53 00000100:00100000:3.0:1788568852.195996:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+34:14554:x1875449958493440:12345-192.168.206.4@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788568852.196326:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044200/0x41e82f464b6a2407 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.196348:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044200/0x41e82f464b6a2407 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.196383:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044200/0x41e82f464b6a2407 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788568852.201697:0:14421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1788568852.201730:0:14421:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 486609802104ns, next at 487609796790ns, rc = 0 00000004:00010000:2.0:1788568852.201899:0:14421:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f509dc2e reply state 000000000129e008 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044200/0x41e82f464b6a2407 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568852.201913:0:14421:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788568852.202415:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+36:14554:x1875449958493440:12345-192.168.206.4@tcp:36:lhsmtool_posix.0 Request processed in 6414us (6972us total) trans 8589934621 rc 0/0 00000100:00100000:2.0:1788568852.202425:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 53 00010000:00010000:2.0:1788568852.205291:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044200/0x41e82f464b6a2407 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568852.205314:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044200/0x41e82f464b6a2407 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568852.205323:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044200/0x41e82f464b6a2407 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568852.205329:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae282044200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788568852.205334:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044200/0x41e82f464b6a2407 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568852.205344:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044200/0x41e82f464b6a2407 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568852.205365:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ae2430ad000) 00010000:00010000:2.0:1788568852.205368:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788568852.205374:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044200/0x41e82f464b6a2407 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568852.205381:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044200/0x41e82f464b6a2407 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568852.209425:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568852.209594:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958493568 00000100:00100000:0.0:1788568852.209611:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958493568 00000100:00100000:0.0:1788568852.209687:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 54 00000100:00100000:0.0:1788568852.209699:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+35:14554:x1875449958493568:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788568852.209730:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568852.209762:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147a00/0x41e82f464b6a240e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bf019 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568852.210407:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147a00/0x41e82f464b6a240e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf019 expref: 36 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568852.210431:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147a00/0x41e82f464b6a240e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf019 expref: 36 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568852.210459:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ae2430ad000) 00010000:00010000:0.0:1788568852.210462:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788568852.210467:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae253147a00, rc 0) 00000100:00100000:0.0:1788568852.210562:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+36:14554:x1875449958493568:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 865us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568852.210570:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 54 00000100:00100000:1.0:1788568852.215783:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568852.215976:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958493696 00000100:00100000:2.0:1788568852.215989:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958493696 00000100:00100000:2.0:1788568852.216074:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 12 00000100:00100000:2.0:1788568852.216086:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+5:2363:x1875449958493696:12345-192.168.206.4@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788568852.216587:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+6:2363:x1875449958493696:12345-192.168.206.4@tcp:2:lhsmtool_posix.0 Request processed in 499us (813us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788568852.216596:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 12 00000100:00080000:3.0:1788568852.217183:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788568852.220134:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568852.220237:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958493952 00000100:00100000:3.0:1788568852.220250:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958493952 00000100:00100000:3.0:1788568852.220330:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 11 00000100:00100000:3.0:1788568852.220342:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae28170b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+36:14554:x1875449958493952:12345-192.168.206.4@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788568852.223426:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae28170b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+37:14554:x1875449958493952:12345-192.168.206.4@tcp:35:lhsmtool_posix.0 Request processed in 3070us (3290us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788568852.223451:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 11 00000100:00100000:0.0:1788568852.230354:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568852.230749:0:16402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958494208 00000100:00100000:1.0:1788568852.230763:0:16402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958494208 00000100:00100000:1.0:1788568852.230904:0:16402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 55 00000100:00100000:1.0:1788568852.230922:0:16402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+37:14554:x1875449958494208:12345-192.168.206.4@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788568852.231103:0:16402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+37:14554:x1875449958494208:12345-192.168.206.4@tcp:57:lhsmtool_posix.0 Request processed in 187us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568852.231111:0:16402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 55 00000100:00100000:1.0:1788568852.241150:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568852.241227:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958494336 00000100:00100000:3.0:1788568852.241240:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958494336 00000100:00100000:3.0:1788568852.241320:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 56 00000100:00100000:3.0:1788568852.241332:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+37:14554:x1875449958494336:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788568852.241359:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568852.241383:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045600/0x41e82f464b6a2415 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bf020 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.241493:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045c00/0x41e82f464b6a241c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.241509:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045c00/0x41e82f464b6a241c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.241522:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045c00/0x41e82f464b6a241c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788568852.241578:0:14423:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788568852.241611:0:14423:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045c00/0x41e82f464b6a241c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.241647:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045600/0x41e82f464b6a2415 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf020 expref: 39 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.241665:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045c00/0x41e82f464b6a241c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf020 expref: 38 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.241674:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ae2430ad000) 00010000:00010000:3.0:1788568852.241677:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788568852.241681:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae282045c00, rc 0) 00000100:00100000:3.0:1788568852.241797:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+38:14554:x1875449958494336:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 466us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568852.241804:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 56 00000100:00100000:0.0:1788568852.253062:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568852.253451:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958494464 00000100:00100000:3.0:1788568852.253465:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958494464 00000100:00100000:3.0:1788568852.253715:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 13 00000100:00100000:3.0:1788568852.253729:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+6:2364:x1875449958494464:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788568852.253751:0:15105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568852.253778:0:15105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023cd75f1/0x41e82f464b6a2423 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bf027 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788568852.253813:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b6513, blocks: 0x1 00010000:00010000:3.0:1788568852.253854:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=486s v=(0 0) 00010000:00010000:3.0:1788568852.253861:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788568852.253872:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023cd75f1/0x41e82f464b6a2423 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf027 expref: 7 pid: 15105 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.253922:0:15105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000023cd75f1/0x41e82f464b6a2423 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf027 expref: 7 pid: 15105 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.253973:0:15105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae282045600, rc 0) 00000100:00100000:3.0:1788568852.254040:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+7:2364:x1875449958494464:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 315us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568852.254047:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 13 00000100:00100000:1.0:1788568852.274713:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568852.276316:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958494720 00000100:00100000:2.0:1788568852.276335:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958494720 00000100:00100000:2.0:1788568852.276424:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 57 00000100:00100000:2.0:1788568852.276438:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+38:14554:x1875449958494720:12345-192.168.206.4@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788568852.276589:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+38:14554:x1875449958494720:12345-192.168.206.4@tcp:57:lhsmtool_posix.0 Request processed in 153us (1890us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568852.277500:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 57 00000100:00100000:0.0:1788568852.286269:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568852.286729:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958494848 00000100:00100000:3.0:1788568852.286743:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958494848 00000100:00100000:3.0:1788568852.286818:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 58 00000100:00100000:3.0:1788568852.286831:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+38:14554:x1875449958494848:12345-192.168.206.4@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788568852.460819:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934615 is committed 00000001:00080000:1.0:1788568852.460915:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934616 is committed 00000001:00080000:1.0:1788568852.460957:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:1.0:1788568852.460965:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934618 is committed 00000001:00080000:1.0:1788568852.460974:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:1.0:1788568852.460978:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:1.0:1788568852.460984:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1788568852.461787:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae28170bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976302976:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788568852.462584:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568852.462944:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976302976 00000100:00100000:3.0:1788568852.462953:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976302976 00000100:00100000:3.0:1788568852.463013:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788568852.463024:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976302976:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788568852.463214:0:15106:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788568852.463218:0:15106:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788568852.463220:0:15106:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788568852.463222:0:15106:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788568851 -> 1788568851 00002000:00010000:3.0:1788568852.463225:0:15106:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788568852.463280:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1875449976302976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 256us (696us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1788568852.463306:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:3.0:1788568852.463362:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ae28170bb80/2, rc 0, transno 8589934595 00000100:00100000:3.0:1788568852.463369:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae28170bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976302976:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788568852.463427:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+13:14554:x1875449958494848:12345-192.168.206.4@tcp:44:lhsmtool_posix.0 Request processed in 175641us (176226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568852.463442:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 58 00000100:00100000:0.0:1788568852.467369:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568852.468187:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958494976 00000100:00100000:1.0:1788568852.468203:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958494976 00000100:00100000:1.0:1788568852.468627:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 15 00000100:00100000:1.0:1788568852.468641:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+7:2363:x1875449958494976:12345-192.168.206.4@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788568852.468789:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+7:2363:x1875449958494976:12345-192.168.206.4@tcp:16:lhsmtool_posix.0 Request processed in 150us (1433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568852.468797:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 15 00000100:00100000:0.0:1788568852.490649:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568852.493269:0:16402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958495232 00000100:00100000:1.0:1788568852.493288:0:16402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958495232 00000100:00100000:1.0:1788568852.493381:0:16402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 59 00000100:00100000:1.0:1788568852.493394:0:16402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273b67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+13:14554:x1875449958495232:12345-192.168.206.4@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788568852.493471:0:16402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788568852.493513:0:16402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045c00/0x41e82f464b6a241c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf020 expref: 13 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.493543:0:16402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ae2430ad000) 00010000:00010000:1.0:1788568852.493550:0:16402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788568852.493621:0:16402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00c00/0x41e82f464b6a242a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.493638:0:16402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00c00/0x41e82f464b6a242a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.493650:0:16402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00c00/0x41e82f464b6a242a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788568852.494062:0:16402:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008dfbbddd reply state 00000000dd67eca8 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00c00/0x41e82f464b6a242a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568852.494072:0:16402:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788568852.494195:0:16402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273b67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+14:14554:x1875449958495232:12345-192.168.206.4@tcp:36:lhsmtool_posix.0 Request processed in 802us (3557us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1788568852.494203:0:16402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 59 00000100:00100000:3.0:1788568852.512138:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568852.512182:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568852.512203:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568852.512222:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568852.512239:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568852.512277:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00010000:00010000:3.0:1788568852.512306:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00c00/0x41e82f464b6a242a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.512321:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00c00/0x41e82f464b6a242a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.512331:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00c00/0x41e82f464b6a242a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.512337:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae277a00c00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568852.512343:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00c00/0x41e82f464b6a242a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.512352:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00c00/0x41e82f464b6a242a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.512434:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ae2430ad000) 00010000:00010000:3.0:1788568852.512438:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788568852.512445:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00c00/0x41e82f464b6a242a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.512470:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00c00/0x41e82f464b6a242a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568852.512507:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958495488 00000100:00100000:3.0:1788568852.512519:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958495488 00000100:00100000:3.0:1788568852.512586:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 122 00000100:00100000:3.0:1788568852.512596:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fb89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54c998a2-cb2f-4cd7-8309-f29c84f83a13+13:2364:x1875449958495488:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:3.0:1788568852.512679:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fb89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54c998a2-cb2f-4cd7-8309-f29c84f83a13+13:2364:x1875449958495488:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 84us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568852.512688:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 122 00000100:00100000:3.0:1788568852.512722:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958495744 00000100:00100000:3.0:1788568852.512726:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958495744 00000100:00100000:3.0:1788568852.512764:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 29 00000100:00100000:3.0:1788568852.512771:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+6:2364:x1875449958495744:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:3.0:1788568852.512807:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+6:2364:x1875449958495744:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 36us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568852.512813:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 29 00000100:00080000:3.0:1788568852.512833:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788568852.512845:0:15721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958495360 00000100:00100000:3.0:1788568852.512848:0:15721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958495360 00000100:00100000:3.0:1788568852.512865:0:15721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958496000 00000100:00100000:3.0:1788568852.512867:0:15721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958496000 00000100:00100000:3.0:1788568852.512885:0:15721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958495616 00000100:00100000:3.0:1788568852.512887:0:15721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958495616 00000100:00100000:3.0:1788568852.512899:0:15721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958495872 00000100:00100000:3.0:1788568852.512901:0:15721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958495872 00000100:00100000:3.0:1788568852.512916:0:15721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 16 00000100:00100000:3.0:1788568852.512921:0:15721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+5:2364:x1875449958496000:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:3.0:1788568852.512982:0:15721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+5:2364:x1875449958496000:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 60us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568852.512989:0:15721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 16 00000100:00100000:3.0:1788568852.513001:0:15721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 17 00000100:00100000:3.0:1788568852.513007:0:15721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+5:2364:x1875449958495616:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:3.0:1788568852.513028:0:15721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+5:2364:x1875449958495616:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 21us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568852.513034:0:15721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 17 00000100:00100000:3.0:1788568852.513045:0:15721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 18 00000100:00100000:3.0:1788568852.513051:0:15721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+5:2364:x1875449958495872:12345-192.168.206.4@tcp:400:kworker.0 00000100:00100000:3.0:1788568852.513073:0:15721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ca5e95b8-1a6c-4c41-8942-85f6bd97825b+5:2364:x1875449958495872:12345-192.168.206.4@tcp:400:kworker.0 Request processed in 23us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568852.513079:0:15721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 18 00000100:00100000:3.0:1788568852.513088:0:15721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 16 00000100:00100000:3.0:1788568852.513093:0:15721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+7:14554:x1875449958495360:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788568852.513104:0:15721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568852.513122:0:15721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006500a370/0x41e82f464b6a2431 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bf02e expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.513150:0:15721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000023cd75f1/0x41e82f464b6a2423 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf027 expref: 8 pid: 15105 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.513160:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788568852.513164:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788568852.513180:0:15721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006500a370/0x41e82f464b6a2431 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf02e expref: 8 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.513218:0:15721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000023cd75f1/0x41e82f464b6a2423 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf027 expref: 8 pid: 15105 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.513232:0:15721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000023cd75f1/0x41e82f464b6a2423 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf027 expref: 8 pid: 15105 timeout: 586 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568852.513246:0:15721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244b37480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15721:1875449976303104:192.168.206.4@tcp:104: 00000100:00100000:3.0:1788568852.513315:0:15721:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae26fb73300 going to sleep for 11 seconds 00000100:00080000:3.0:1788568852.513329:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788568852.513331:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788568852.515824:0:15721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244b37480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15721:1875449976303104:192.168.206.4@tcp:104: 00010000:00010000:2.0:1788568852.515952:0:15721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006500a370/0x41e82f464b6a2431 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf02e expref: 8 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568852.515977:0:15721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae282045000, rc 0) 00000100:00100000:2.0:1788568852.516045:0:15721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+8:14554:x1875449958495360:12345-192.168.206.4@tcp:101:lhsmtool_posix.0 Request processed in 2950us (3920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568852.516055:0:15721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 16 00000100:00100000:3.0:1788568852.521314:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568852.522473:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958496128 00000100:00100000:0.0:1788568852.522488:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958496128 00010000:00010000:0.0:1788568852.522560:0:14406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000023cd75f1/0x41e82f464b6a2423 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf027 expref: 8 pid: 15105 timeout: 586 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568852.522613:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 14 00000100:00100000:0.0:1788568852.522624:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+8:2363:x1875449958496128:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788568852.522651:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568852.522680:0:14406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000023cd75f1/0x41e82f464b6a2423 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf027 expref: 8 pid: 15105 timeout: 586 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568852.522695:0:14406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000023cd75f1/0x41e82f464b6a2423 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf027 expref: 8 pid: 15105 timeout: 586 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568852.522734:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023cd75f1/0x41e82f464b6a2423 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf027 expref: 8 pid: 15105 timeout: 586 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568852.522757:0:14406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788568852.522762:0:14406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788568852.522771:0:14406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006500a370/0x41e82f464b6a2431 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf02e expref: 7 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568852.522782:0:14406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006500a370/0x41e82f464b6a2431 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf02e expref: 7 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568852.522854:0:14406:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006500a370/0x41e82f464b6a2431 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf02e expref: 7 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568852.522870:0:14406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273b66680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14406:1875449976303232:192.168.206.4@tcp:105: 00000100:00100000:0.0:1788568852.523238:0:14406:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae250af9000 going to sleep for 11 seconds 00000100:00100000:0.0:1788568852.527334:0:14406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273b66680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14406:1875449976303232:192.168.206.4@tcp:105: 00000100:00100000:3.0:1788568852.527351:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00010000:00010000:0.0:1788568852.527366:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788568852.527434:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+7:2363:x1875449958496128:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 4809us (6130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568852.527448:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 14 00000100:00100000:2.0:1788568852.533134:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958496256 00000100:00100000:2.0:1788568852.533158:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958496256 00000100:00100000:2.0:1788568852.533261:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 17 00000100:00100000:2.0:1788568852.533274:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+7:2364:x1875449958496256:12345-192.168.206.4@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788568852.533594:0:15105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788568852.533598:0:15105:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788568850 00002000:00010000:2.0:1788568852.533601:0:15105:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788568848 00002000:00010000:2.0:1788568852.533603:0:15105:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788568851 -> 1788568850 00002000:00010000:2.0:1788568852.533605:0:15105:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788568852.533683:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+8:2364:x1875449958496256:12345-192.168.206.4@tcp:2:lhsmtool_posix.0 Request processed in 411us (6331us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788568852.533692:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 17 00000100:00100000:0.0:1788568852.546332:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568852.546699:0:15721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958496384 00000100:00100000:2.0:1788568852.546713:0:15721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958496384 00000100:00100000:2.0:1788568852.547091:0:15721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 18 00000100:00100000:2.0:1788568852.547105:0:15721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+8:2364:x1875449958496384:12345-192.168.206.4@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788568852.547166:0:15721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007aadeb27/0x41e82f464b6a2438 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568852.547190:0:15721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006500a370/0x41e82f464b6a2431 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf02e expref: 8 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568852.547200:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788568852.547206:0:15721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788568852.547211:0:15721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007aadeb27/0x41e82f464b6a2438 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568852.548989:0:15721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006500a370/0x41e82f464b6a2431 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf02e expref: 8 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568852.549067:0:15721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006500a370/0x41e82f464b6a2431 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf02e expref: 8 pid: 15721 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568852.549089:0:15721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae28170aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15721:1875449976303360:192.168.206.4@tcp:104: 00000100:00100000:2.0:1788568852.549210:0:15721:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae252512a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788568852.559259:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568852.559305:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958496512 00000100:00100000:3.0:1788568852.559316:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958496512 00010000:00010000:3.0:1788568852.559364:0:14408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006500a370/0x41e82f464b6a2431 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf02e expref: 9 pid: 15721 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568852.559406:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 15 00000100:00100000:3.0:1788568852.559417:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244b37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+9:2364:x1875449958496512:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788568852.559433:0:14408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568852.559469:0:14408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006500a370/0x41e82f464b6a2431 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf02e expref: 9 pid: 15721 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.559506:0:14408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006500a370/0x41e82f464b6a2431 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf02e expref: 9 pid: 15721 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.559548:0:14408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788568852.559553:0:14408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788568852.559560:0:14408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007aadeb27/0x41e82f464b6a2438 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.559570:0:14408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007aadeb27/0x41e82f464b6a2438 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.559594:0:14408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788568852.559678:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244b37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+9:2364:x1875449958496512:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 263us (1308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568852.559687:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 15 00010000:00010000:3.0:1788568852.559758:0:15721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006500a370/0x41e82f464b6a2431 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf02e expref: 8 pid: 15721 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568852.559774:0:15721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae28170aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15721:1875449976303360:192.168.206.4@tcp:104: 00010000:00010000:3.0:1788568852.559798:0:15721:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007aadeb27/0x41e82f464b6a2438 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.559809:0:15721:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007aadeb27/0x41e82f464b6a2438 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.561099:0:15721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007aadeb27/0x41e82f464b6a2438 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.561139:0:15721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007aadeb27/0x41e82f464b6a2438 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.561148:0:15721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007aadeb27/0x41e82f464b6a2438 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.561166:0:15721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007aadeb27/0x41e82f464b6a2438 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.561173:0:15721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae142d6aa00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788568852.561179:0:15721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007aadeb27/0x41e82f464b6a2438 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.561188:0:15721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007aadeb27/0x41e82f464b6a2438 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.561209:0:15721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007aadeb27/0x41e82f464b6a2438 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.561217:0:15721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007aadeb27/0x41e82f464b6a2438 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568852.561403:0:15721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+7:2364:x1875449958496384:12345-192.168.206.4@tcp:1:lhsmtool_posix.0 Request processed in 14295us (15146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568852.561415:0:15721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 18 00000100:00100000:3.0:1788568852.569146:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568852.569188:0:16402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958496768 00000100:00100000:3.0:1788568852.569198:0:16402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958496768 00000100:00100000:3.0:1788568852.569276:0:16402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 60 00000100:00100000:3.0:1788568852.569289:0:16402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273aa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+13:14554:x1875449958496768:12345-192.168.206.4@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788568852.569390:0:16402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045200/0x41e82f464b6a243f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.569411:0:16402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045200/0x41e82f464b6a243f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.569425:0:16402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045200/0x41e82f464b6a243f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.569750:0:16402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045a00/0x41e82f464b6a2446 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.569762:0:16402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147a00/0x41e82f464b6a240e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf019 expref: 14 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.569772:0:16402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045a00/0x41e82f464b6a2446 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.569815:0:16402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147a00/0x41e82f464b6a240e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf019 expref: 14 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.569831:0:16402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147a00/0x41e82f464b6a240e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf019 expref: 14 pid: 14422 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568852.569860:0:16402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae281b03480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16402:1875449976303488:192.168.206.4@tcp:104: 00000100:00100000:3.0:1788568852.569983:0:16402:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae248dc6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788568852.580572:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568852.580616:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958496896 00000100:00100000:3.0:1788568852.580628:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958496896 00010000:00010000:3.0:1788568852.580678:0:14406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147a00/0x41e82f464b6a240e lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf019 expref: 15 pid: 14422 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568852.580783:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 16 00000100:00100000:3.0:1788568852.580795:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+15:2364:x1875449958496896:12345-192.168.206.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788568852.580813:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568852.580822:0:14406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147a00/0x41e82f464b6a240e lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf019 expref: 15 pid: 14422 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.580837:0:14406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147a00/0x41e82f464b6a240e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf019 expref: 15 pid: 14422 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.580865:0:14406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ae2430ad000) 00010000:00010000:3.0:1788568852.580871:0:14406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045a00/0x41e82f464b6a2446 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.580883:0:14406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045a00/0x41e82f464b6a2446 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.580892:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045a00/0x41e82f464b6a2446 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.580957:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788568852.581013:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+15:2364:x1875449958496896:12345-192.168.206.4@tcp:103:ldlm_bl.0 Request processed in 220us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568852.581021:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 16 00010000:00010000:2.0:1788568852.590193:0:16402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae253147a00/0x41e82f464b6a240e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf019 expref: 14 pid: 14422 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568852.590226:0:16402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae281b03480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16402:1875449976303488:192.168.206.4@tcp:104: 00010000:00010000:2.0:1788568852.590267:0:16402:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045a00/0x41e82f464b6a2446 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568852.590279:0:16402:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045a00/0x41e82f464b6a2446 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568852.590285:0:16402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045a00/0x41e82f464b6a2446 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788568852.590812:0:16402:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:2.0:1788568852.591025:0:16402:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:2.0:1788568852.591076:0:16402:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:2.0:1788568852.591180:0:16402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae28170b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16402:1875449976303616:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788568852.595759:0:16402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568852.595854:0:16402:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae141ef3840 going to sleep for 11 seconds 00000100:00100000:3.0:1788568852.601964:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976303616 00000100:00100000:3.0:1788568852.601985:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976303616 00000100:00100000:3.0:1788568852.602043:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788568852.602055:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16402:x1875449976303616:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788568852.602233:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16402:x1875449976303616:12345-0@lo:1000:mdt00_003.0 Request processed in 180us (6486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568852.602240:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788568852.603438:0:16402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae28170b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16402:1875449976303616:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1788568852.604879:0:16402:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:1.0:1788568852.605018:0:16402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16402:1875449976303744:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788568852.605096:0:16402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568852.605134:0:16402:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae253076540 going to sleep for 11 seconds 00000100:00100000:0.0:1788568852.605422:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976303744 00000100:00100000:0.0:1788568852.605431:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976303744 00000100:00100000:0.0:1788568852.605485:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788568852.605497:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:16402:x1875449976303744:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788568852.605718:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:16402:x1875449976303744:12345-0@lo:1000:mdt00_003.0 Request processed in 223us (621us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788568852.605726:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788568852.605785:0:16402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16402:1875449976303744:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788568852.605827:0:16402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045a00/0x41e82f464b6a2446 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568852.605839:0:16402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045a00/0x41e82f464b6a2446 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568852.605864:0:16402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045a00/0x41e82f464b6a2446 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568852.605870:0:16402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae282045a00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568852.605875:0:16402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045a00/0x41e82f464b6a2446 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568852.605884:0:16402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045a00/0x41e82f464b6a2446 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568852.605905:0:16402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ae2430ad000) 00010000:00010000:0.0:1788568852.605909:0:16402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788568852.605915:0:16402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045a00/0x41e82f464b6a2446 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568852.605923:0:16402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045a00/0x41e82f464b6a2446 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568852.605991:0:16402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00000/0x41e82f464b6a239e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568852.605999:0:16402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00000/0x41e82f464b6a239e lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568852.606005:0:16402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00000/0x41e82f464b6a239e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568852.606011:0:16402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae277a00000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788568852.606014:0:16402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00000/0x41e82f464b6a239e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568852.606030:0:16402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00000/0x41e82f464b6a239e lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568852.606040:0:16402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae25d03e700) 00010000:00010000:0.0:1788568852.606042:0:16402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788568852.606051:0:16402:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a23a5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beffd expref: 17 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568852.606063:0:16402:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a23a5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beffd expref: 17 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568852.606073:0:16402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a23a5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beffd expref: 17 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568852.606105:0:16402:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2429dec00/0x41e82f464b6a23a5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9beffd expref: 17 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568852.606119:0:16402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae273b67480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16402:1875449976303872:192.168.206.4@tcp:105: 00000100:00100000:0.0:1788568852.606219:0:16402:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae250af9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788568852.632061:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:1.0:1788568852.632396:0:16402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae273b67480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16402:1875449976303872:192.168.206.4@tcp:105: 00010000:00010000:1.0:1788568852.632435:0:16402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00000/0x41e82f464b6a239e lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.632446:0:16402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a00000/0x41e82f464b6a239e lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.632493:0:16402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01400/0x41e82f464b6a244d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.632543:0:16402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01400/0x41e82f464b6a244d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.632557:0:16402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01400/0x41e82f464b6a244d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.632568:0:16402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01400/0x41e82f464b6a244d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.632574:0:16402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01400/0x41e82f464b6a244d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.632580:0:16402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01400/0x41e82f464b6a244d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.632585:0:16402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae277a01400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568852.632589:0:16402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01400/0x41e82f464b6a244d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.632604:0:16402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01400/0x41e82f464b6a244d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.632617:0:16402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae25d03e700) 00010000:00010000:1.0:1788568852.632620:0:16402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788568852.632624:0:16402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01400/0x41e82f464b6a244d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.632630:0:16402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01400/0x41e82f464b6a244d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.632640:0:16402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045200/0x41e82f464b6a243f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.633117:0:16402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045200/0x41e82f464b6a243f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.633128:0:16402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045200/0x41e82f464b6a243f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.633134:0:16402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae282045200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788568852.633136:0:16402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045200/0x41e82f464b6a243f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.633143:0:16402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045200/0x41e82f464b6a243f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.633153:0:16402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae25d03e700) 00010000:00010000:1.0:1788568852.633156:0:16402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788568852.633159:0:16402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045200/0x41e82f464b6a243f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.633165:0:16402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045200/0x41e82f464b6a243f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16402 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568852.633681:0:16402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273aa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+17:14554:x1875449958496768:12345-192.168.206.4@tcp:57:lhsmtool_posix.0 Request processed in 64242us (64395us total) trans 8589934628 rc 0/0 00000100:00100000:1.0:1788568852.633695:0:16402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 60 00000020:00080000:1.0:1788568852.633703:0:16402:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788568852.633961:0:14454:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788568852.633966:0:14454:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788568852.633998:0:14454:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788568852.634005:0:14454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788568852.639795:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568852.639857:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958497024 00000100:00100000:3.0:1788568852.639870:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958497024 00000100:00100000:3.0:1788568852.639921:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958497280 00000100:00100000:3.0:1788568852.639924:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958497280 00000100:00100000:3.0:1788568852.639963:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 12 00000100:00100000:3.0:1788568852.639973:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281b03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+18:14553:x1875449958497024:12345-192.168.206.4@tcp:49:bash.0 00000100:00100000:3.0:1788568852.640135:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281b03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+18:14553:x1875449958497024:12345-192.168.206.4@tcp:49:bash.0 Request processed in 163us (8087us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568852.640143:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 12 00000100:00100000:3.0:1788568852.640181:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 13 00000100:00100000:3.0:1788568852.640187:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281b02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+17:14554:x1875449958497280:12345-192.168.206.4@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788568852.648115:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568852.648161:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958497408 00000100:00100000:0.0:1788568852.648172:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958497408 00000100:00100000:0.0:1788568852.648233:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 19 00000100:00100000:0.0:1788568852.648245:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae273b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+7:14553:x1875449958497408:12345-192.168.206.4@tcp:101:bash.0 00010000:00010000:0.0:1788568852.648731:0:15105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568852.648759:0:15105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf7bb7a9/0x41e82f464b6a2454 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bf035 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788568852.648818:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9b6512, atime: 0x6a9b6510, ctime: 0x6a9b6512, blocks: 0x1 00010000:00010000:0.0:1788568852.648847:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=487s v=(0 0) 00010000:00010000:0.0:1788568852.648853:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788568852.648866:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf7bb7a9/0x41e82f464b6a2454 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf035 expref: 8 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568852.648888:0:15105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bf7bb7a9/0x41e82f464b6a2454 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf035 expref: 8 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568852.648902:0:15105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae253146a00, rc 0) 00000100:00100000:0.0:1788568852.648999:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae273b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+8:14553:x1875449958497408:12345-192.168.206.4@tcp:101:bash.0 Request processed in 756us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568852.649008:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 19 00000004:00080000:1.0:1788568852.657117:0:14424:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788568852.657267:0:14424:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:1.0:1788568852.657354:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01400/0x41e82f464b6a245b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.657389:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01400/0x41e82f464b6a245b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.657403:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01400/0x41e82f464b6a245b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.657413:0:14424:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01400/0x41e82f464b6a245b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.657419:0:14424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01400/0x41e82f464b6a245b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.657425:0:14424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01400/0x41e82f464b6a245b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568852.657442:0:14424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:3.0:1788568852.658493:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00080000:3.0:1788568852.658520:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00010000:00010000:0.0:1788568852.658916:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788568852.658987:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01400/0x41e82f464b6a245b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568852.658998:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae277a01400 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788568852.659003:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01400/0x41e82f464b6a245b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568852.659025:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01400/0x41e82f464b6a245b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568852.659058:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ae2430ad000) 00010000:00010000:0.0:1788568852.659074:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788568852.659093:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01400/0x41e82f464b6a245b lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568852.659100:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae277a01400/0x41e82f464b6a245b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568852.659114:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568852.659116:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568852.659117:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568852.661188:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281b02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+19:14554:x1875449958497280:12345-192.168.206.4@tcp:35:lhsmtool_posix.0 Request processed in 20983us (21391us total) trans 8589934630 rc 0/0 00000100:00100000:1.0:1788568852.661206:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 13 00000020:00080000:1.0:1788568852.661216:0:14424:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788568852.668023:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568852.668125:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958497664 00000100:00100000:2.0:1788568852.668138:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958497664 00000100:00100000:2.0:1788568852.668194:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 14 00000100:00100000:2.0:1788568852.668207:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+19:14553:x1875449958497664:12345-192.168.206.4@tcp:35:bash.0 00000001:00080000:2.0:1788568852.668545:0:14425:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:2.0:1788568852.668664:0:14425:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:2.0:1788568852.668793:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+22:14553:x1875449958497664:12345-192.168.206.4@tcp:35:bash.0 Request processed in 588us (782us total) trans 8589934633 rc 0/0 00000100:00100000:2.0:1788568852.668802:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 14 00000020:00080000:2.0:1788568852.668808:0:14425:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1788568852.727899:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568852.798289:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568852.798398:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958497920 00000100:00100000:3.0:1788568852.798411:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958497920 00000100:00100000:3.0:1788568852.798492:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 61 00000100:00100000:3.0:1788568852.798505:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b566300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+22:14564:x1875449958497920:12345-192.168.206.4@tcp:101:lfs.0 00010000:00010000:3.0:1788568852.798547:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568852.798574:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045e00/0x41e82f464b6a2462 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef604d3a3e9bf03c expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788568852.798703:0:14422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788568852.798864:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045e00/0x41e82f464b6a2462 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf03c expref: 24 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.798882:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae25d03e500) 00010000:00010000:3.0:1788568852.798885:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788568852.798892:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045e00/0x41e82f464b6a2462 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.4@tcp remote: 0xef604d3a3e9bf03c expref: 24 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.798910:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae282045e00, rc 0) 00000100:00100000:3.0:1788568852.799043:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b566300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+23:14564:x1875449958497920:12345-192.168.206.4@tcp:101:lfs.0 Request processed in 540us (768us total) trans 8589934634 rc 301/301 00000100:00100000:3.0:1788568852.799050:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 61 00000100:00100000:2.0:1788568852.808737:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:3.0:1788568852.808903:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958498048 00000100:00100000:3.0:1788568852.808917:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958498048 00000100:00100000:3.0:1788568852.809041:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 62 00000100:00100000:3.0:1788568852.809053:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+23:14564:x1875449958498048:12345-192.168.206.4@tcp:34:lfs.0 00010000:00010000:3.0:1788568852.809158:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045e00/0x41e82f464b6a2470 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.809179:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045e00/0x41e82f464b6a2470 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.809194:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045e00/0x41e82f464b6a2470 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.809211:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045000/0x41e82f464b6a2477 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.809218:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045000/0x41e82f464b6a2477 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.809225:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045000/0x41e82f464b6a2477 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.809839:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044e00/0x41e82f464b6a247e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.809851:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044e00/0x41e82f464b6a247e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.809860:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044e00/0x41e82f464b6a247e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788568852.809907:0:14421:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044e00/0x41e82f464b6a247e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.809922:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045e00/0x41e82f464b6a2470 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.809963:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045e00/0x41e82f464b6a2470 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.809971:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045e00/0x41e82f464b6a2470 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.809978:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae282045e00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568852.809983:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045e00/0x41e82f464b6a2470 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.809990:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045e00/0x41e82f464b6a2470 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.810004:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ae24a9c0d00) 00010000:00010000:3.0:1788568852.810008:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788568852.810013:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045e00/0x41e82f464b6a2470 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.810020:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045e00/0x41e82f464b6a2470 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.810034:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045000/0x41e82f464b6a2477 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.810041:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045000/0x41e82f464b6a2477 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.810047:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045000/0x41e82f464b6a2477 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.810052:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae282045000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568852.810060:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045000/0x41e82f464b6a2477 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.810067:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045000/0x41e82f464b6a2477 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.810074:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9ae2430ad600) 00010000:00010000:3.0:1788568852.810076:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788568852.810079:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045000/0x41e82f464b6a2477 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.810086:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282045000/0x41e82f464b6a2477 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.810102:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044e00/0x41e82f464b6a247e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.810108:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044e00/0x41e82f464b6a247e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.810114:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044e00/0x41e82f464b6a247e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.810119:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae282044e00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788568852.810122:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044e00/0x41e82f464b6a247e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.810128:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044e00/0x41e82f464b6a247e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.810134:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae25d03e700) 00010000:00010000:3.0:1788568852.810136:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788568852.810143:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044e00/0x41e82f464b6a247e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568852.810148:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae282044e00/0x41e82f464b6a247e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568852.810405:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+23:14564:x1875449958498048:12345-192.168.206.4@tcp:34:lfs.0 Request processed in 1349us (1678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568852.810415:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 62 00000100:00100000:2.0:1788568852.816001:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568852.816099:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958498304 00000100:00100000:0.0:1788568852.816112:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958498304 00000100:00100000:0.0:1788568852.816185:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 15 00000100:00100000:0.0:1788568852.816198:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae28170a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+23:14564:x1875449958498304:12345-192.168.206.4@tcp:35:lfs.0 00000100:00100000:0.0:1788568852.816563:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae28170a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+24:14564:x1875449958498304:12345-192.168.206.4@tcp:35:lfs.0 Request processed in 366us (650us total) trans 8589934635 rc 0/0 00000100:00100000:0.0:1788568852.816573:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 15 00010000:00010000:0.0:1788568853.751491:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568854.521746:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788568854.521767:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae27b567800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976304000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788568854.521832:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568854.521967:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976304000 00000100:00100000:0.0:1788568854.521976:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976304000 00000100:00100000:0.0:1788568854.522031:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788568854.522041:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875449976304000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788568854.522074:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788568854.522121:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875449976304000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568854.522129:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788568854.522167:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934595 gen 2 00000004:00080000:0.0:1788568854.522182:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ae28170bb80, transno 8589934595 00000100:00100000:0.0:1788568854.522197:0:3308:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9ae2739ef480 x1875449976303744/t8589934597(8589934597) o1000->lustre-OST0000-osc-MDT0000@0@lo:24/4 lens 408/4320 e 0 to 0 dl 1788568868 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'mdt00_003.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568854.522213:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae27b567800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976304000:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788568854.522808:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788568854.775079:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788568855.176080:0:16685:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:0.0:1788568855.801753:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568856.089359:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:0.0:1788568856.089403:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.4@tcp (source: 12345-192.168.206.4@tcp) 00000100:00100000:2.0:1788568856.089502:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958498432 00000100:00100000:2.0:1788568856.089521:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958498432 00002000:00100000:2.0:1788568856.089584:0:15110:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff9ae27b567800 x1875449958498432/t0(0) o4->bf0a011c-1a89-4994-b3cd-fb988f4b42d4@192.168.206.4@tcp:292/0 lens 504/0 e 0 to 0 dl 1788568867 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788568856.089595:0:15110:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae27b567800 with x1875449958498432 ext(0->8) 00002000:00010000:2.0:1788568856.089600:0:15110:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ae27b567800 00000100:00100000:2.0:1788568856.089624:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 0 00000100:00100000:2.0:1788568856.089633:0:15110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b567800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+7:2364:x1875449958498432:12345-192.168.206.4@tcp:4:bash.0 00000100:00100000:2.0:1788568856.090128:0:15110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b567800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+9:2364:x1875449958498432:12345-192.168.206.4@tcp:4:bash.0 Request processed in 495us (777us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1788568856.090136:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 0 00002000:00100000:2.0:1788568856.090143:0:15110:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff9ae27b567800 x1875449958498432/t8589934598(0) o4->bf0a011c-1a89-4994-b3cd-fb988f4b42d4@192.168.206.4@tcp:292/0 lens 504/448 e 0 to 0 dl 1788568867 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788568856.090165:0:15110:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae27b567800 with x1875449958498432 ext(0->8) 00002000:00010000:2.0:1788568856.090169:0:15110:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ae27b567800 00000100:00080000:0.0:1788568856.090337:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788568856.090545:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449958498560 00000100:00100000:3.0:1788568856.090552:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449958498560 00000100:00100000:3.0:1788568856.090592:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.4@tcp, seq: 20 00000100:00100000:3.0:1788568856.090601:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b565f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+9:2364:x1875449958498560:12345-192.168.206.4@tcp:16:kworker.0 00000100:00100000:2.0:1788568856.164259:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b565f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf0a011c-1a89-4994-b3cd-fb988f4b42d4+9:2364:x1875449958498560:12345-192.168.206.4@tcp:16:kworker.0 Request processed in 73649us (74844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568856.164271:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.4@tcp, seq: 20 00000001:00080000:0.0:1788568856.164451:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:0.0:1788568856.164464:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000100:00100000:2.0:1788568856.567153:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bbee97af-a6b0-4265-8c9f-26b826a76798:3306:1875449976304128:0@lo:400:kworker.0 00000100:00100000:2.0:1788568856.567240:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568856.567422:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976304384:0@lo:400:kworker.0 00000100:00100000:0.0:1788568856.567457:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568856.567498:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788568856.567515:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976304512:0@lo:400:kworker.0 00000100:00100000:0.0:1788568856.567540:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568856.567569:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976304384 00000100:00100000:0.0:1788568856.567576:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976304384 00000100:00100000:0.0:1788568856.567625:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976304512 00000100:00100000:0.0:1788568856.567628:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976304512 00000100:00100000:0.0:1788568856.567650:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788568856.567658:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b566a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976304384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568856.567705:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b566a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976304384:12345-0@lo:400:kworker.0 Request processed in 48us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568856.567712:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788568856.567728:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788568856.567733:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae27b566680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976304512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568856.567776:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae27b566680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875449976304512:12345-0@lo:400:kworker.0 Request processed in 43us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568856.567783:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1788568856.567798:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788568856.567802:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788568856.567839:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976304512:0@lo:400:kworker.0 00000100:00100000:0.0:1788568856.567849:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1788568856.567854:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:0.0:1788568856.567871:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875449976304384:0@lo:400:kworker.0 00000100:00100000:0.0:1788568856.567908:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976304128 00000100:00100000:0.0:1788568856.567912:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976304128 00000100:00100000:0.0:1788568856.567964:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788568856.567972:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae26fb88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+19:3306:x1875449976304128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568856.574849:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae281b02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976304256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788568856.574923:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568856.575101:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788568856.575115:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875449976304896:0@lo:400:kworker.0 00000100:00100000:1.0:1788568856.575148:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568856.575208:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976304896 00000100:00100000:1.0:1788568856.575215:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976304896 00000100:00100000:3.0:1788568856.575216:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875449976304768:0@lo:400:kworker.0 00000100:00100000:3.0:1788568856.575530:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568856.575553:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788568856.575560:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2739ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875449976304640:0@lo:400:kworker.0 00000100:00100000:3.0:1788568856.575583:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568856.575611:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976304256 00000100:00100000:3.0:1788568856.575616:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976304256 00000100:00100000:3.0:1788568856.575660:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788568856.575668:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281b01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976304256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788568856.575701:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788568856.575745:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281b01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875449976304256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568856.575762:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788568856.575833:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976304768 00000100:00100000:1.0:1788568856.575838:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976304768 00000100:00100000:1.0:1788568856.575851:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449976304640 00000100:00100000:1.0:1788568856.575853:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449976304640 00000100:00100000:1.0:1788568856.575865:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788568856.575871:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2739ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875449976304896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568856.575910:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2739ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875449976304896:12345-0@lo:400:kworker.0 Request processed in 38us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568856.575917:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788568856.576012:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788568856.576021:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281b00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875449976304768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568856.576038:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae26fb88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbee97af-a6b0-4265-8c9f-26b826a76798+19:3306:x1875449976304128:12345-0@lo:400:kworker.0 Request processed in 8063us (8794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568856.576056:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281b00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875449976304768:12345-0@lo:400:kworker.0 Request processed in 36us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568856.576064:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788568856.576077:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788568856.576083:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae281b00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875449976304640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568856.576109:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae281b00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875449976304640:12345-0@lo:400:kworker.0 Request processed in 27us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568856.576145:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788568856.576202:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1788568856.576208:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788568856.576542:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875449976304896:0@lo:400:kworker.0 00000100:00100000:3.0:1788568856.577146:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae281b02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875449976304256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788568856.577874:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bbee97af-a6b0-4265-8c9f-26b826a76798:3306:1875449976304128:0@lo:400:kworker.0 00000100:00100000:3.0:1788568856.580664:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875449976304640:0@lo:400:kworker.0 00000100:00100000:3.0:1788568856.580683:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2739ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875449976304768:0@lo:400:kworker.0 00010000:00010000:0.0:1788568856.824395:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29883 lines, 29883 kept, 0 dropped, 0 bad.